Nov 02 04:38:54 user nova-compute[75216]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75216) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75216) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75216) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 04:38:54 user nova-compute[75216]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:38:54 user nova-compute[75216]: INFO nova.virt.driver [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 02 04:38:54 user nova-compute[75216]: INFO nova.compute.provider_config [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Acquiring lock "singleton_lock" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Acquired lock "singleton_lock" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Releasing lock "singleton_lock" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Full set of CONF: {{(pid=75216) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ******************************************************************************** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Configuration options gathered from: {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ================================================================================ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] allow_resize_to_same_host      = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] arq_binding_timeout            = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] backdoor_port                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] backdoor_socket                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] block_device_allocate_retries  = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] block_device_allocate_retries_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cert                           = self.pem {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute_monitors               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] config_dir                     = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] config_drive_format            = iso9660 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] config_source                  = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] console_host                   = user {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] control_exchange               = nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cpu_allocation_ratio           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] daemon                         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] debug                          = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] default_access_ip_network_name = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] default_availability_zone      = nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] default_ephemeral_format       = ext4 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] default_green_pool_size        = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] default_schedule_zone          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] disk_allocation_ratio          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] enable_new_services            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] enabled_ssl_apis               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] flat_injected                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] force_config_drive             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] force_raw_images               = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] graceful_shutdown_timeout      = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] heal_instance_info_cache_interval = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] host                           = user {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instance_build_timeout         = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instance_delete_interval       = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instance_name_template         = instance-%08x {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instance_usage_audit           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instance_usage_audit_period    = month {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] internal_service_availability_zone = internal {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] key                            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] live_migration_retry_count     = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_config_append              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_dir                        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_file                       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_options                    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_rotate_interval            = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_rotate_interval_type       = days {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] log_rotation_type              = none {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] long_rpc_timeout               = 1800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] max_concurrent_builds          = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] max_concurrent_live_migrations = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] max_concurrent_snapshots       = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] max_local_block_devices        = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] max_logfile_count              = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] max_logfile_size_mb            = 200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] maximum_instance_delete_attempts = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] metadata_listen                = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] metadata_listen_port           = 8775 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] metadata_workers               = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] migrate_max_retries            = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] mkisofs_cmd                    = genisoimage {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] my_ip                          = 10.0.0.210 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] network_allocate_retries       = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] osapi_compute_listen_port      = 8774 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] osapi_compute_unique_server_name_scope =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] osapi_compute_workers          = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] password_length                = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] periodic_enable                = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] periodic_fuzzy_delay           = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] pointer_model                  = ps2mouse {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] preallocate_images             = none {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] publish_errors                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] pybasedir                      = /opt/stack/nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ram_allocation_ratio           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rate_limit_burst               = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rate_limit_except_level        = CRITICAL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rate_limit_interval            = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] reboot_timeout                 = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] reclaim_instance_interval      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] record                         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] reimage_timeout_per_gb         = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] report_interval                = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rescue_timeout                 = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] reserved_host_cpus             = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] reserved_host_disk_mb          = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] reserved_host_memory_mb        = 512 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] reserved_huge_pages            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] resize_confirm_window          = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] resize_fs_using_block_device   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] resume_guests_state_on_host_boot = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rpc_response_timeout           = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] run_external_periodic_tasks    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] running_deleted_instance_action = reap {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] running_deleted_instance_timeout = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler_instance_sync_interval = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_down_time              = 720 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] servicegroup_driver            = db {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] shelved_offload_time           = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] shelved_poll_interval          = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] shutdown_timeout               = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] source_is_ipv6                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ssl_only                       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] state_path                     = /opt/stack/data/nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] sync_power_state_interval      = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] sync_power_state_pool_size     = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] syslog_log_facility            = LOG_USER {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] tempdir                        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] timeout_nbd                    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] transport_url                  = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] update_resources_interval      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] use_cow_images                 = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] use_eventlog                   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] use_journal                    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] use_json                       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] use_rootwrap_daemon            = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] use_stderr                     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] use_syslog                     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vcpu_pin_set                   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plugging_is_fatal          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plugging_timeout           = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] virt_mkfs                      = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] volume_usage_poll_interval     = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] watch_log_file                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] web                            = /usr/share/spice-html5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_concurrency.disable_process_locking = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.auth_strategy              = keystone {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.compute_link_prefix        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.dhcp_domain                = novalocal {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.enable_instance_password   = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.glance_link_prefix         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.instance_list_per_project_cells = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.list_records_by_skipping_down_cells = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.local_metadata_per_cell    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.max_limit                  = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.metadata_cache_expiration  = 15 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.neutron_default_tenant_id  = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.use_forwarded_for          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.use_neutron_default_nets   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.vendordata_dynamic_targets = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.vendordata_jsonfile_path   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.backend_argument         = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.config_prefix            = cache.oslo {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.dead_timeout             = 60.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.debug_cache_backend      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.enable_retry_client      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.enable_socket_keepalive  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.enabled                  = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.expiration_time          = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.hashclient_retry_attempts = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_dead_retry      = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_password        =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_sasl_enabled    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.memcache_username        =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.proxies                  = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.retry_attempts           = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.retry_delay              = 0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.socket_keepalive_count   = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.socket_keepalive_idle    = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.socket_keepalive_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.tls_allowed_ciphers      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.tls_cafile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.tls_certfile             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.tls_enabled              = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cache.tls_keyfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.auth_section            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.auth_type               = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.cross_az_attach         = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.debug                   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.endpoint_template       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.http_retries            = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.os_region_name          = RegionOne {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cinder.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.cpu_dedicated_set      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.cpu_shared_set         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.image_type_exclude_list = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.resource_provider_association_refresh = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.shutdown_retry_interval = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] conductor.workers              = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] console.allowed_origins        = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] console.ssl_ciphers            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] console.ssl_minimum_version    = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] consoleauth.token_ttl          = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.connect_retries         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.connect_retry_delay     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.endpoint_override       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.max_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.min_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.region_name             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.service_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.service_type            = accelerator {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.status_code_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] cyborg.version                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.backend               = sqlalchemy {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.connection            = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.connection_debug      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.connection_parameters =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.connection_recycle_time = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.connection_trace      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.db_inc_retry_interval = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.db_max_retries        = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.db_max_retry_interval = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.db_retry_interval     = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.max_overflow          = 50 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.max_pool_size         = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.max_retries           = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.mysql_wsrep_sync_wait = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.pool_timeout          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.retry_interval        = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.slave_connection      = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] database.sqlite_synchronous    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.backend           = sqlalchemy {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.connection        = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.connection_debug  = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.connection_parameters =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.connection_recycle_time = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.connection_trace  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.db_inc_retry_interval = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.db_max_retries    = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.db_max_retry_interval = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.db_retry_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.max_overflow      = 50 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.max_pool_size     = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.max_retries       = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.pool_timeout      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.retry_interval    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.slave_connection  = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] api_database.sqlite_synchronous = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] devices.enabled_mdev_types     = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ephemeral_storage_encryption.enabled = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.api_servers             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.connect_retries         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.connect_retry_delay     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.debug                   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.default_trusted_certificate_ids = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.enable_certificate_validation = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.enable_rbd_download     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.endpoint_override       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.max_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.min_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.num_retries             = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.rbd_ceph_conf           =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.rbd_connect_timeout     = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.rbd_pool                =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.rbd_user                =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.region_name             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.service_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.service_type            = image {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.status_code_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.verify_glance_signatures = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] glance.version                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] guestfs.debug                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.config_drive_cdrom      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.config_drive_inject_password = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.enable_remotefx         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.instances_path_share    =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.limit_cpu_features      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.use_multipath_io        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.vswitch_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] mks.enabled                    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] image_cache.manager_interval   = 2400 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] image_cache.precache_concurrency = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] image_cache.remove_unused_base_images = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] image_cache.subdirectory_name  = _base {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.api_max_retries         = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.api_retry_interval      = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.auth_section            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.auth_type               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.conductor_group         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.connect_retries         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.connect_retry_delay     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.endpoint_override       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.max_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.min_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.peer_list               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.region_name             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.serial_console_state_timeout = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.service_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.service_type            = baremetal {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.status_code_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ironic.version                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] key_manager.fixed_key          = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.barbican_api_version  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.barbican_endpoint     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.barbican_endpoint_type = public {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.barbican_region_name  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.cafile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.certfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.collect_timing        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.insecure              = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.keyfile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.number_of_retries     = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.retry_delay           = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.send_service_user_token = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.split_loggers         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.timeout               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.verify_ssl            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican.verify_ssl_path       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.auth_section = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.auth_type = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.cafile   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.certfile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.collect_timing = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.insecure = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.keyfile  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.split_loggers = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] barbican_service_user.timeout  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.approle_role_id          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.approle_secret_id        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.cafile                   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.certfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.collect_timing           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.insecure                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.keyfile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.kv_mountpoint            = secret {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.kv_path                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.kv_version               = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.namespace                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.root_token_id            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.split_loggers            = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.ssl_ca_crt_file          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.timeout                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.use_ssl                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.auth_section          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.auth_type             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.cafile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.certfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.collect_timing        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.connect_retries       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.connect_retry_delay   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.endpoint_override     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.insecure              = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.keyfile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.max_version           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.min_version           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.region_name           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.service_name          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.service_type          = identity {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.split_loggers         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.status_code_retries   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.timeout               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] keystone.version               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.connection_uri         =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.cpu_mode               = custom {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: WARNING oslo_config.cfg [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.cpu_power_governor_high = performance {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.cpu_power_management   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.device_detach_attempts = 8 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.device_detach_timeout  = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.disk_cachemodes        = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.disk_prefix            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.enabled_perf_events    = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.file_backed_memory     = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.gid_maps               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.hw_disk_discard        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.hw_machine_type        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.images_rbd_pool        = rbd {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.images_type            = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.images_volume_group    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.inject_key             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.inject_partition       = -2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.inject_password        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.iscsi_iface            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.iser_use_multipath     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_downtime = 500 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_inbound_addr = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_scheme  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_timeout_action = abort {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_tunnelled = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: WARNING oslo_config.cfg [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 02 04:38:54 user nova-compute[75216]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 02 04:38:54 user nova-compute[75216]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 02 04:38:54 user nova-compute[75216]: and ``live_migration_inbound_addr`` respectively.
Nov 02 04:38:54 user nova-compute[75216]: ).  Its value may be silently ignored in the future.
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.live_migration_with_native_tls = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.max_queues             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.nfs_mount_options      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.num_pcie_ports         = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.pmem_namespaces        = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.quobyte_client_cfg     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rbd_secret_uuid        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rbd_user               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rescue_image_id        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rescue_kernel_id       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.rx_queue_size          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.smbfs_mount_options    =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.snapshot_compression   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.snapshot_image_format  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.sparse_logical_volumes = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.swtpm_enabled          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.swtpm_group            = tss {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.swtpm_user             = tss {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.sysinfo_serial         = unique {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.tb_cache_size          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.tx_queue_size          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.uid_maps               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.use_virtio_for_bridges = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.virt_type              = kvm {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.volume_clear           = zero {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.volume_clear_size      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.volume_use_multipath   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.vzstorage_cache_path   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.auth_section           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.auth_type              = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.cafile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.certfile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.collect_timing         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.connect_retries        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.connect_retry_delay    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.default_floating_pool  = public {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.endpoint_override      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.extension_sync_interval = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.http_retries           = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.insecure               = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.keyfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.max_version            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.min_version            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.ovs_bridge             = br-int {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.physnets               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.region_name            = RegionOne {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.service_metadata_proxy = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.service_name           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.service_type           = network {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.split_loggers          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.status_code_retries    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.timeout                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] neutron.version                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] notifications.bdms_in_notifications = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] notifications.default_level    = INFO {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] notifications.notification_format = unversioned {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] notifications.notify_on_state_change = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] pci.alias                      = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] pci.device_spec                = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] pci.report_in_placement        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.auth_section         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.auth_type            = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.cafile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.certfile             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.collect_timing       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.connect_retries      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.connect_retry_delay  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.default_domain_id    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.default_domain_name  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.domain_id            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.domain_name          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.endpoint_override    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.insecure             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.keyfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.max_version          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.min_version          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.password             = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.project_domain_id    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.project_domain_name  = Default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.project_id           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.project_name         = service {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.region_name          = RegionOne {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.service_name         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.service_type         = placement {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.split_loggers        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.status_code_retries  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.system_scope         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.timeout              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.trust_id             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.user_domain_id       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.user_domain_name     = Default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.user_id              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.username             = placement {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] placement.version              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.cores                    = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.count_usage_from_placement = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.injected_file_content_bytes = 10240 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.injected_file_path_length = 255 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.injected_files           = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.instances                = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.key_pairs                = 100 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.metadata_items           = 128 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.ram                      = 51200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.recheck_quota            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.server_group_members     = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] quota.server_groups            = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rdp.enabled                    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.image_metadata_prefilter = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.max_attempts         = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.max_placement_results = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] scheduler.workers              = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.host_subset_size = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.isolated_hosts = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.isolated_images = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.pci_in_placement = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.track_instance_changes = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] metrics.required               = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] metrics.weight_multiplier      = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] metrics.weight_setting         = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] serial_console.enabled         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] serial_console.port_range      = 10000:20000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] serial_console.serialproxy_port = 6083 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.auth_section      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.auth_type         = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.cafile            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.certfile          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.collect_timing    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.insecure          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.keyfile           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.send_service_user_token = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.split_loggers     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] service_user.timeout           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.agent_enabled            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.enabled                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.html5proxy_port          = 6082 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.image_compression        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.jpeg_compression         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.playback_compression     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.server_listen            = 127.0.0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.streaming_mode           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] spice.zlib_compression         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] upgrade_levels.baseapi         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] upgrade_levels.cert            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] upgrade_levels.compute         = auto {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] upgrade_levels.conductor       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] upgrade_levels.scheduler       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.cafile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.certfile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.insecure = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vendordata_dynamic_auth.timeout = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.api_retry_count         = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.ca_file                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.cache_prefix            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.cluster_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.connection_pool_size    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.console_delay_seconds   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.datastore_regex         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.host_ip                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.host_password           = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.host_port               = 443 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.host_username           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.integration_bridge      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.maximum_objects         = 100 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.pbm_default_policy      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.pbm_enabled             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.pbm_wsdl_location       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.serial_port_proxy_uri   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.serial_port_service_uri = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.task_poll_interval      = 0.5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.use_linked_clone        = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.vnc_keymap              = en-us {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.vnc_port                = 5900 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vmware.vnc_port_total          = 10000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.auth_schemes               = ['none'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.enabled                    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.novncproxy_port            = 6080 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.vencrypt_ca_certs          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.vencrypt_client_cert       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vnc.vencrypt_client_key        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.disable_rootwrap   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.enable_numa_live_migration = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.libvirt_disable_apic = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.client_socket_timeout     = 900 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.default_pool_size         = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.keep_alive                = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.max_header_line           = 16384 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.ssl_ca_file               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.ssl_cert_file             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.ssl_key_file              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.tcp_keepidle              = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] zvm.ca_file                    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] zvm.cloud_connector_url        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] zvm.reachable_timeout          = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.enforce_new_defaults = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.enforce_scope      = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.policy_default_rule = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.connection_string     = messaging:// {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.enabled               = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.es_doc_type           = notification {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.es_scroll_size        = 10000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.es_scroll_time        = 2m {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.filter_error_trace    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.hmac_keys             = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.sentinel_service_name = mymaster {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.socket_timeout        = 0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.trace_requests        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler.trace_sqlalchemy      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler_jaeger.process_tags   = {} {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler_jaeger.service_name_prefix = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] profiler_otlp.service_name_prefix = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] remote_debug.host              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] remote_debug.port              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:54 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_notifications.retry = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.auth_section        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.auth_type           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.cafile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.certfile            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.collect_timing      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.connect_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.connect_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.endpoint_id         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.endpoint_override   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.insecure            = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.keyfile             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.max_version         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.min_version         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.region_name         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.service_name        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.service_type        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.split_loggers       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.status_code_retries = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.timeout             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.valid_interfaces    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_limit.version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_reports.file_event_handler = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] oslo_reports.log_dir           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_ovs_privileged.group  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] vif_plug_ovs_privileged.user   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_ovs.isolate_vif         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] os_brick.lock_path             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] privsep_osbrick.capabilities   = [21] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] privsep_osbrick.group          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] privsep_osbrick.helper_command = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] privsep_osbrick.user           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] nova_sys_admin.group           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] nova_sys_admin.helper_command  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] nova_sys_admin.user            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG oslo_service.service [None req-5f791841-53fd-4df0-9b24-7231ff7d3c61 None None] ******************************************************************************** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 02 04:38:55 user nova-compute[75216]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 02 04:38:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Connecting to libvirt: qemu:///system {{(pid=75216) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f460d6e7010> {{(pid=75216) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 02 04:38:55 user nova-compute[75216]: libvirt:  error : internal error: could not initialize domain event timer
Nov 02 04:38:55 user nova-compute[75216]: WARNING nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 02 04:38:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f460d6e7010> {{(pid=75216) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Starting native event thread {{(pid=75216) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Starting green dispatch thread {{(pid=75216) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 02 04:38:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Starting connection event dispatch thread {{(pid=75216) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 02 04:38:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Connection event '1' reason 'None'
Nov 02 04:38:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 04:38:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.mount [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Initialising _HostMountState generation 0 {{(pid=75216) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 02 04:39:02 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host capabilities <capabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <host>
Nov 02 04:39:02 user nova-compute[75216]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 02 04:39:02 user nova-compute[75216]:     <cpu>
Nov 02 04:39:02 user nova-compute[75216]:       <arch>x86_64</arch>
Nov 02 04:39:02 user nova-compute[75216]:       <model>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <microcode version='1070'/>
Nov 02 04:39:02 user nova-compute[75216]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 02 04:39:02 user nova-compute[75216]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='osxsave'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='invtsc'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='rsba'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature name='skip-l1dfl-vmentry'/>
Nov 02 04:39:02 user nova-compute[75216]:       <pages unit='KiB' size='4'/>
Nov 02 04:39:02 user nova-compute[75216]:       <pages unit='KiB' size='2048'/>
Nov 02 04:39:02 user nova-compute[75216]:     </cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <power_management>
Nov 02 04:39:02 user nova-compute[75216]:       <suspend_mem/>
Nov 02 04:39:02 user nova-compute[75216]:       <suspend_disk/>
Nov 02 04:39:02 user nova-compute[75216]:       <suspend_hybrid/>
Nov 02 04:39:02 user nova-compute[75216]:     </power_management>
Nov 02 04:39:02 user nova-compute[75216]:     <iommu support='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <migration_features>
Nov 02 04:39:02 user nova-compute[75216]:       <live/>
Nov 02 04:39:02 user nova-compute[75216]:       <uri_transports>
Nov 02 04:39:02 user nova-compute[75216]:         <uri_transport>tcp</uri_transport>
Nov 02 04:39:02 user nova-compute[75216]:         <uri_transport>rdma</uri_transport>
Nov 02 04:39:02 user nova-compute[75216]:       </uri_transports>
Nov 02 04:39:02 user nova-compute[75216]:     </migration_features>
Nov 02 04:39:02 user nova-compute[75216]:     <topology>
Nov 02 04:39:02 user nova-compute[75216]:       <cells num='2'>
Nov 02 04:39:02 user nova-compute[75216]:         <cell id='0'>
Nov 02 04:39:02 user nova-compute[75216]:           <memory unit='KiB'>8189224</memory>
Nov 02 04:39:02 user nova-compute[75216]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 02 04:39:02 user nova-compute[75216]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 04:39:02 user nova-compute[75216]:           <distances>
Nov 02 04:39:02 user nova-compute[75216]:             <sibling id='0' value='10'/>
Nov 02 04:39:02 user nova-compute[75216]:             <sibling id='1' value='20'/>
Nov 02 04:39:02 user nova-compute[75216]:           </distances>
Nov 02 04:39:02 user nova-compute[75216]:           <cpus num='6'>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 02 04:39:02 user nova-compute[75216]:           </cpus>
Nov 02 04:39:02 user nova-compute[75216]:         </cell>
Nov 02 04:39:02 user nova-compute[75216]:         <cell id='1'>
Nov 02 04:39:02 user nova-compute[75216]:           <memory unit='KiB'>8206460</memory>
Nov 02 04:39:02 user nova-compute[75216]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 02 04:39:02 user nova-compute[75216]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 04:39:02 user nova-compute[75216]:           <distances>
Nov 02 04:39:02 user nova-compute[75216]:             <sibling id='0' value='20'/>
Nov 02 04:39:02 user nova-compute[75216]:             <sibling id='1' value='10'/>
Nov 02 04:39:02 user nova-compute[75216]:           </distances>
Nov 02 04:39:02 user nova-compute[75216]:           <cpus num='6'>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 02 04:39:02 user nova-compute[75216]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 02 04:39:02 user nova-compute[75216]:           </cpus>
Nov 02 04:39:02 user nova-compute[75216]:         </cell>
Nov 02 04:39:02 user nova-compute[75216]:       </cells>
Nov 02 04:39:02 user nova-compute[75216]:     </topology>
Nov 02 04:39:02 user nova-compute[75216]:     <cache>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 02 04:39:02 user nova-compute[75216]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 02 04:39:02 user nova-compute[75216]:     </cache>
Nov 02 04:39:02 user nova-compute[75216]:     <secmodel>
Nov 02 04:39:02 user nova-compute[75216]:       <model>apparmor</model>
Nov 02 04:39:02 user nova-compute[75216]:       <doi>0</doi>
Nov 02 04:39:02 user nova-compute[75216]:     </secmodel>
Nov 02 04:39:02 user nova-compute[75216]:     <secmodel>
Nov 02 04:39:02 user nova-compute[75216]:       <model>dac</model>
Nov 02 04:39:02 user nova-compute[75216]:       <doi>0</doi>
Nov 02 04:39:02 user nova-compute[75216]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 02 04:39:02 user nova-compute[75216]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 02 04:39:02 user nova-compute[75216]:     </secmodel>
Nov 02 04:39:02 user nova-compute[75216]:   </host>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='alpha'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>clipper</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='armv6l'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>spitz</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>nuri</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>kzm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sx1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>z2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>tosa</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>n810</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>n800</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>terrier</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>midway</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>microbit</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>verdex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>highbank</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>akita</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>connex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>collie</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='armv7l'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>spitz</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>nuri</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>kzm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sx1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>z2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>tosa</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>n810</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>n800</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>terrier</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>midway</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>microbit</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>verdex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>highbank</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>akita</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>connex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>collie</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='aarch64'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>spitz</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>nuri</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>kzm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sx1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>z2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>tosa</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>n810</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>n800</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>terrier</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>midway</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>microbit</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>verdex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>raspi3b</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>highbank</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>akita</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>connex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>collie</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <acpi default='on' toggle='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='cris'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='i686'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>isapc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>microvm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='kvm'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <pae/>
Nov 02 04:39:02 user nova-compute[75216]:       <nonpae/>
Nov 02 04:39:02 user nova-compute[75216]:       <acpi default='on' toggle='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:       <apic default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='m68k'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>an5206</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>q800</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>next-cube</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='microblaze'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='microblazeel'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='mips'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='mipsel'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='mips64'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>pica61</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>magnum</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='mips64el'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>pica61</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>magnum</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='16'>boston</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='ppc'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mac99</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>40p</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>taihu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='ppc64'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>taihu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>40p</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mac99</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='ppc64le'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>taihu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>40p</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>mac99</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='riscv32'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='8'>spike</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>opentitan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='8'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='riscv64'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='8'>spike</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>shakti_c</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='8'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='s390x'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='sh4'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>shix</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>r2d</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='sh4eb'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>shix</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>r2d</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='sparc'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>SS-5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>SS-20</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>LX</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>SS-4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>SS-10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>Voyager</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='sparc64'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sun4u</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>niagara</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>sun4v</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='x86_64'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='1'>isapc</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>microvm</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='kvm'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <acpi default='on' toggle='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:       <apic default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='xtensa'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>sim</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>kc705</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>ml605</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx200</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx60</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]:   <guest>
Nov 02 04:39:02 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 02 04:39:02 user nova-compute[75216]:     <arch name='xtensaeb'>
Nov 02 04:39:02 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 02 04:39:02 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='4'>sim</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>kc705</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>ml605</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>virt</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx200</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>lx60</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 04:39:02 user nova-compute[75216]:       <domain type='qemu'/>
Nov 02 04:39:02 user nova-compute[75216]:     </arch>
Nov 02 04:39:02 user nova-compute[75216]:     <features>
Nov 02 04:39:02 user nova-compute[75216]:       <cpuselection/>
Nov 02 04:39:02 user nova-compute[75216]:       <deviceboot/>
Nov 02 04:39:02 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     </features>
Nov 02 04:39:02 user nova-compute[75216]:   </guest>
Nov 02 04:39:02 user nova-compute[75216]: </capabilities>
Nov 02 04:39:02 user nova-compute[75216]: 
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-q35-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>i686</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='288'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'/>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-i440fx-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>i686</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='255'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'/>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ide</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-q35-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>i686</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='288'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'/>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-i440fx-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>i686</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='255'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'/>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ide</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-q35-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='288'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>efi</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-i440fx-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='255'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>efi</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ide</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-q35-6.2</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='288'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>efi</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 02 04:39:02 user nova-compute[75216]: <domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 04:39:02 user nova-compute[75216]:   <domain>kvm</domain>
Nov 02 04:39:02 user nova-compute[75216]:   <machine>pc-i440fx-jammy</machine>
Nov 02 04:39:02 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 02 04:39:02 user nova-compute[75216]:   <vcpu max='255'/>
Nov 02 04:39:02 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:   <os supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='firmware'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>efi</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:     <loader supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>rom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pflash</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='readonly'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>yes</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='secure'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>no</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </loader>
Nov 02 04:39:02 user nova-compute[75216]:   </os>
Nov 02 04:39:02 user nova-compute[75216]:   <cpu>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>on</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>off</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 02 04:39:02 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 02 04:39:02 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 02 04:39:02 user nova-compute[75216]:     </mode>
Nov 02 04:39:02 user nova-compute[75216]:   </cpu>
Nov 02 04:39:02 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:     <enum name='sourceType'>
Nov 02 04:39:02 user nova-compute[75216]:       <value>file</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>anonymous</value>
Nov 02 04:39:02 user nova-compute[75216]:       <value>memfd</value>
Nov 02 04:39:02 user nova-compute[75216]:     </enum>
Nov 02 04:39:02 user nova-compute[75216]:   </memoryBacking>
Nov 02 04:39:02 user nova-compute[75216]:   <devices>
Nov 02 04:39:02 user nova-compute[75216]:     <disk supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>disk</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cdrom</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>floppy</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>lun</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='bus'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ide</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>fdc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sata</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </disk>
Nov 02 04:39:02 user nova-compute[75216]:     <graphics supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='type'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>sdl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vnc</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>spice</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egl-headless</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </graphics>
Nov 02 04:39:02 user nova-compute[75216]:     <video supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='modelType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>cirrus</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>vmvga</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>qxl</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>none</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>bochs</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>ramfb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </video>
Nov 02 04:39:02 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='mode'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>subsystem</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>default</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>mandatory</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>requisite</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>optional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='subsysType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>usb</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>pci</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>scsi</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='capsType'/>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 02 04:39:02 user nova-compute[75216]:     </hostdev>
Nov 02 04:39:02 user nova-compute[75216]:     <rng supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>random</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>egd</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>builtin</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </rng>
Nov 02 04:39:02 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='driverType'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>path</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>handle</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>virtiofs</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </filesystem>
Nov 02 04:39:02 user nova-compute[75216]:     <tpm supported='yes'>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='model'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:       <enum name='backendModel'>
Nov 02 04:39:02 user nova-compute[75216]:         <value>passthrough</value>
Nov 02 04:39:02 user nova-compute[75216]:         <value>emulator</value>
Nov 02 04:39:02 user nova-compute[75216]:       </enum>
Nov 02 04:39:02 user nova-compute[75216]:     </tpm>
Nov 02 04:39:02 user nova-compute[75216]:   </devices>
Nov 02 04:39:02 user nova-compute[75216]:   <features>
Nov 02 04:39:02 user nova-compute[75216]:     <gic supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <genid supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <backup supported='yes'/>
Nov 02 04:39:02 user nova-compute[75216]:     <sev supported='no'/>
Nov 02 04:39:02 user nova-compute[75216]:   </features>
Nov 02 04:39:02 user nova-compute[75216]: </domainCapabilities>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Checking secure boot support for host arch (x86_64) {{(pid=75216) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 04:39:02 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Secure Boot support detected
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] cpu compare xml: <cpu match="exact">
Nov 02 04:39:02 user nova-compute[75216]:   <model>Nehalem</model>
Nov 02 04:39:02 user nova-compute[75216]: </cpu>
Nov 02 04:39:02 user nova-compute[75216]:  {{(pid=75216) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 02 04:39:02 user nova-compute[75216]: INFO nova.virt.node [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Generated node identity d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3
Nov 02 04:39:02 user nova-compute[75216]: INFO nova.virt.node [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Wrote node identity d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 to /opt/stack/data/nova/compute_id
Nov 02 04:39:02 user nova-compute[75216]: WARNING nova.compute.manager [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Compute nodes ['d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 02 04:39:02 user nova-compute[75216]: INFO nova.compute.manager [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 02 04:39:02 user nova-compute[75216]: WARNING nova.compute.manager [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 04:39:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:39:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:39:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:39:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Hypervisor/Node resource view: name=user free_ram=10935MB free_disk=26.021209716796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:39:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:39:02 user nova-compute[75216]: WARNING nova.compute.resource_tracker [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] No compute node record for user:d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 could not be found.
Nov 02 04:39:02 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Compute node record created for user:user with uuid: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:39:03 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] [req-860aecb7-7350-4865-ba99-157c5e3a3c40] Created resource provider record via placement API for resource provider with UUID d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 and name user.
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75216) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 02 04:39:03 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] kernel doesn't support AMD SEV
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Libvirt baseline CPU <cpu>
Nov 02 04:39:03 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 02 04:39:03 user nova-compute[75216]:   <model>Nehalem</model>
Nov 02 04:39:03 user nova-compute[75216]:   <vendor>Intel</vendor>
Nov 02 04:39:03 user nova-compute[75216]:   <topology sockets="6" cores="1" threads="1"/>
Nov 02 04:39:03 user nova-compute[75216]: </cpu>
Nov 02 04:39:03 user nova-compute[75216]:  {{(pid=75216) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Updated inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Updating resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 generation from 0 to 1 during operation: update_inventory {{(pid=75216) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Updating resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 generation from 1 to 2 during operation: update_traits {{(pid=75216) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.service [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Creating RPC server for service compute {{(pid=75216) start /opt/stack/nova/nova/service.py:182}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.service [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] Join ServiceGroup membership for this service compute {{(pid=75216) start /opt/stack/nova/nova/service.py:199}}
Nov 02 04:39:03 user nova-compute[75216]: DEBUG nova.servicegroup.drivers.db [None req-0acda0c4-cd28-48a6-8e7c-d95e9bf81e0d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75216) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 02 04:39:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:39:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:39:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=10345MB free_disk=25.925029754638672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:40:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:40:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:40:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=10294MB free_disk=25.977493286132812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:41:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:41:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:41:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=25.74274444580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:41:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:41:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:41:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:41:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 04:41:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 04:42:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:42:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:42:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:42:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=9581MB free_disk=25.770042419433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:42:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:42:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:42:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:42:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:42:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 04:42:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 04:42:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:01 user nova-compute[75216]: INFO nova.compute.claims [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Claim successful on node user
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Creating image(s)
Nov 02 04:43:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "/opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "/opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "/opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:02 user nova-compute[75216]: DEBUG nova.policy [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99e34f43747842bf940dd4962cccc8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30a37a0127643bf855abd107709f46c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:02 user nova-compute[75216]: INFO nova.compute.claims [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Claim successful on node user
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.707s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.part --force-share --output=json" returned: 0 in 0.292s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.virt.images [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] 68d67248-2499-473c-a9cd-909ea99614c1 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.part /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.part /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.converted" returned: 0 in 0.267s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.policy [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae71d7b88da2452a9ec4489a0ef49176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6771c51304d446b8338d0d879ede48f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Creating image(s)
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.057s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:03 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplhjc3brc/privsep.sock']
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.059s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:03 user sudo[84471]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplhjc3brc/privsep.sock
Nov 02 04:43:04 user sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 04:43:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Successfully created port: 6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Successfully created port: 65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:05 user sudo[84471]: pam_unix(sudo:session): session closed for user root
Nov 02 04:43:05 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Spawned new privsep daemon via rootwrap
Nov 02 04:43:05 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 04:43:05 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 04:43:05 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 02 04:43:05 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84474
Nov 02 04:43:05 user nova-compute[75216]: WARNING oslo_privsep.priv_context [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] privsep daemon already running
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.236s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk 1073741824" returned: 0 in 0.059s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Cannot resize image /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Ensure instance console log exists: /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.154s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Cannot resize image /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Ensure instance console log exists: /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Successfully updated port: 6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquired lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Updating instance_info_cache with network_info: [{"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Releasing lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Instance network_info: |[{"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Start _get_guest_xml network_info=[{"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1048258121',display_name='tempest-DeleteServersTestJSON-server-1048258121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1048258121',id=1,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30a37a0127643bf855abd107709f46c',ramdisk_id='',reservation_id='r-lipr52dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-67129306',owner_user_name='tempest-DeleteServersTestJSON-67129306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:02Z,user_data=None,user_id='99e34f43747842bf940dd4962cccc8b0',uuid=277ca9ec-2c10-4312-98f3-9d27b70fc078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Converting VIF {"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bd:ff,bridge_name='br-int',has_traffic_filtering=True,id=6b72af68-a0e3-4de8-9d0e-3b6189a0738c,network=Network(c95ad790-b882-4126-889f-4996824dd81b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b72af68-a0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.objects.instance [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lazy-loading 'pci_devices' on Instance uuid 277ca9ec-2c10-4312-98f3-9d27b70fc078 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:08 user nova-compute[75216]:   <uuid>277ca9ec-2c10-4312-98f3-9d27b70fc078</uuid>
Nov 02 04:43:08 user nova-compute[75216]:   <name>instance-00000001</name>
Nov 02 04:43:08 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:08 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:08 user nova-compute[75216]:   <metadata>
Nov 02 04:43:08 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:08 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:08 user nova-compute[75216]:       <nova:name>tempest-DeleteServersTestJSON-server-1048258121</nova:name>
Nov 02 04:43:08 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:08</nova:creationTime>
Nov 02 04:43:08 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:08 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:08 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:08 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:08 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:08 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:08 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:08 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:08 user nova-compute[75216]:         <nova:user uuid="99e34f43747842bf940dd4962cccc8b0">tempest-DeleteServersTestJSON-67129306-project-member</nova:user>
Nov 02 04:43:08 user nova-compute[75216]:         <nova:project uuid="f30a37a0127643bf855abd107709f46c">tempest-DeleteServersTestJSON-67129306</nova:project>
Nov 02 04:43:08 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:08 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:08 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:08 user nova-compute[75216]:         <nova:port uuid="6b72af68-a0e3-4de8-9d0e-3b6189a0738c">
Nov 02 04:43:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 04:43:08 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:08 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:08 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:08 user nova-compute[75216]:   </metadata>
Nov 02 04:43:08 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:08 user nova-compute[75216]:     <system>
Nov 02 04:43:08 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:08 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:08 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:08 user nova-compute[75216]:       <entry name="serial">277ca9ec-2c10-4312-98f3-9d27b70fc078</entry>
Nov 02 04:43:08 user nova-compute[75216]:       <entry name="uuid">277ca9ec-2c10-4312-98f3-9d27b70fc078</entry>
Nov 02 04:43:08 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:08 user nova-compute[75216]:     </system>
Nov 02 04:43:08 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:08 user nova-compute[75216]:   <os>
Nov 02 04:43:08 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:08 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:08 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:08 user nova-compute[75216]:   </os>
Nov 02 04:43:08 user nova-compute[75216]:   <features>
Nov 02 04:43:08 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:08 user nova-compute[75216]:     <apic/>
Nov 02 04:43:08 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:08 user nova-compute[75216]:   </features>
Nov 02 04:43:08 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:08 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:08 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:08 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:08 user nova-compute[75216]:   </clock>
Nov 02 04:43:08 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:08 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:08 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:08 user nova-compute[75216]:   </cpu>
Nov 02 04:43:08 user nova-compute[75216]:   <devices>
Nov 02 04:43:08 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:08 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:08 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk"/>
Nov 02 04:43:08 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:08 user nova-compute[75216]:     </disk>
Nov 02 04:43:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:08 user nova-compute[75216]:       <mac address="fa:16:3e:2f:bd:ff"/>
Nov 02 04:43:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:08 user nova-compute[75216]:       <target dev="tap6b72af68-a0"/>
Nov 02 04:43:08 user nova-compute[75216]:     </interface>
Nov 02 04:43:08 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:08 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/console.log" append="off"/>
Nov 02 04:43:08 user nova-compute[75216]:     </serial>
Nov 02 04:43:08 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:08 user nova-compute[75216]:     <video>
Nov 02 04:43:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:08 user nova-compute[75216]:     </video>
Nov 02 04:43:08 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:08 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:08 user nova-compute[75216]:     </rng>
Nov 02 04:43:08 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:08 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:08 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:08 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:08 user nova-compute[75216]:   </devices>
Nov 02 04:43:08 user nova-compute[75216]: </domain>
Nov 02 04:43:08 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1048258121',display_name='tempest-DeleteServersTestJSON-server-1048258121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1048258121',id=1,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30a37a0127643bf855abd107709f46c',ramdisk_id='',reservation_id='r-lipr52dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-67129306',owner_user_name='tempest-DeleteServersTestJSON-67129306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:02Z,user_data=None,user_id='99e34f43747842bf940dd4962cccc8b0',uuid=277ca9ec-2c10-4312-98f3-9d27b70fc078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Converting VIF {"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bd:ff,bridge_name='br-int',has_traffic_filtering=True,id=6b72af68-a0e3-4de8-9d0e-3b6189a0738c,network=Network(c95ad790-b882-4126-889f-4996824dd81b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b72af68-a0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG os_vif [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bd:ff,bridge_name='br-int',has_traffic_filtering=True,id=6b72af68-a0e3-4de8-9d0e-3b6189a0738c,network=Network(c95ad790-b882-4126-889f-4996824dd81b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b72af68-a0') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Created schema index Interface.name {{(pid=75216) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Created schema index Port.name {{(pid=75216) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Created schema index Bridge.name {{(pid=75216) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [POLLOUT] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01560778-ecb2-5382-9e07-b7e6824063ea', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:08 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpb57ayfw9/privsep.sock']
Nov 02 04:43:08 user sudo[84511]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpb57ayfw9/privsep.sock
Nov 02 04:43:08 user sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received event network-changed-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Refreshing instance network info cache due to event network-changed-6b72af68-a0e3-4de8-9d0e-3b6189a0738c. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] Acquiring lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] Acquired lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Refreshing network info cache for port 6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Successfully updated port: 65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received event network-changed-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Refreshing instance network info cache due to event network-changed-65c3201b-92ac-4811-8425-8b6139848766. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] Acquiring lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:10 user sudo[84511]: pam_unix(sudo:session): session closed for user root
Nov 02 04:43:10 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Spawned new privsep daemon via rootwrap
Nov 02 04:43:10 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 04:43:10 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 04:43:10 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 02 04:43:10 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84520
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:10 user nova-compute[75216]: INFO nova.compute.claims [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Claim successful on node user
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b72af68-a0, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b72af68-a0, col_values=(('qos', UUID('5209e264-f823-4f6e-9e74-cf7cd6fb39c4')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b72af68-a0, col_values=(('external_ids', {'iface-id': '6b72af68-a0e3-4de8-9d0e-3b6189a0738c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:bd:ff', 'vm-uuid': '277ca9ec-2c10-4312-98f3-9d27b70fc078'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:10 user nova-compute[75216]: INFO os_vif [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bd:ff,bridge_name='br-int',has_traffic_filtering=True,id=6b72af68-a0e3-4de8-9d0e-3b6189a0738c,network=Network(c95ad790-b882-4126-889f-4996824dd81b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b72af68-a0')
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Updated VIF entry in instance network info cache for port 6b72af68-a0e3-4de8-9d0e-3b6189a0738c. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Updating instance_info_cache with network_info: [{"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1d632207-5465-4416-a9d4-8c11c6b5aa9f req-852edb17-29fb-4c14-a029-304b1e85aa53 service nova] Releasing lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] No VIF found with MAC fa:16:3e:2f:bd:ff, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updating instance_info_cache with network_info: [{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Instance network_info: |[{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] Acquired lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Refreshing network info cache for port 65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Start _get_guest_xml network_info=[{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:10 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:10 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-821388551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-821388551',id=2,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-d2l1urr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:04Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=3b055742-c605-41ab-bd40-1a777b8f4e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:a5,bridge_name='br-int',has_traffic_filtering=True,id=65c3201b-92ac-4811-8425-8b6139848766,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c3201b-92') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b055742-c605-41ab-bd40-1a777b8f4e39 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:10 user nova-compute[75216]:   <uuid>3b055742-c605-41ab-bd40-1a777b8f4e39</uuid>
Nov 02 04:43:10 user nova-compute[75216]:   <name>instance-00000002</name>
Nov 02 04:43:10 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:10 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:10 user nova-compute[75216]:   <metadata>
Nov 02 04:43:10 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:10 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:10 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-821388551</nova:name>
Nov 02 04:43:10 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:10</nova:creationTime>
Nov 02 04:43:10 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:10 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:10 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:10 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:10 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:10 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:10 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:10 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:10 user nova-compute[75216]:         <nova:user uuid="ae71d7b88da2452a9ec4489a0ef49176">tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member</nova:user>
Nov 02 04:43:10 user nova-compute[75216]:         <nova:project uuid="f6771c51304d446b8338d0d879ede48f">tempest-ServerBootFromVolumeStableRescueTest-1501080447</nova:project>
Nov 02 04:43:10 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:10 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:10 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:10 user nova-compute[75216]:         <nova:port uuid="65c3201b-92ac-4811-8425-8b6139848766">
Nov 02 04:43:10 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 04:43:10 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:10 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:10 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:10 user nova-compute[75216]:   </metadata>
Nov 02 04:43:10 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:10 user nova-compute[75216]:     <system>
Nov 02 04:43:10 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:10 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:10 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:10 user nova-compute[75216]:       <entry name="serial">3b055742-c605-41ab-bd40-1a777b8f4e39</entry>
Nov 02 04:43:10 user nova-compute[75216]:       <entry name="uuid">3b055742-c605-41ab-bd40-1a777b8f4e39</entry>
Nov 02 04:43:10 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:10 user nova-compute[75216]:     </system>
Nov 02 04:43:10 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:10 user nova-compute[75216]:   <os>
Nov 02 04:43:10 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:10 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:10 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:10 user nova-compute[75216]:   </os>
Nov 02 04:43:10 user nova-compute[75216]:   <features>
Nov 02 04:43:10 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:10 user nova-compute[75216]:     <apic/>
Nov 02 04:43:10 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:10 user nova-compute[75216]:   </features>
Nov 02 04:43:10 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:10 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:10 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:10 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:10 user nova-compute[75216]:   </clock>
Nov 02 04:43:10 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:10 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:10 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:10 user nova-compute[75216]:   </cpu>
Nov 02 04:43:10 user nova-compute[75216]:   <devices>
Nov 02 04:43:10 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:10 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:10 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk"/>
Nov 02 04:43:10 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:10 user nova-compute[75216]:     </disk>
Nov 02 04:43:10 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:10 user nova-compute[75216]:       <mac address="fa:16:3e:9e:5a:a5"/>
Nov 02 04:43:10 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:10 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:10 user nova-compute[75216]:       <target dev="tap65c3201b-92"/>
Nov 02 04:43:10 user nova-compute[75216]:     </interface>
Nov 02 04:43:10 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:10 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/console.log" append="off"/>
Nov 02 04:43:10 user nova-compute[75216]:     </serial>
Nov 02 04:43:10 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:10 user nova-compute[75216]:     <video>
Nov 02 04:43:10 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:10 user nova-compute[75216]:     </video>
Nov 02 04:43:10 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:10 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:10 user nova-compute[75216]:     </rng>
Nov 02 04:43:10 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:10 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:10 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:10 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:10 user nova-compute[75216]:   </devices>
Nov 02 04:43:10 user nova-compute[75216]: </domain>
Nov 02 04:43:10 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-821388551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-821388551',id=2,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-d2l1urr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:04Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=3b055742-c605-41ab-bd40-1a777b8f4e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:a5,bridge_name='br-int',has_traffic_filtering=True,id=65c3201b-92ac-4811-8425-8b6139848766,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c3201b-92') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG os_vif [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:a5,bridge_name='br-int',has_traffic_filtering=True,id=65c3201b-92ac-4811-8425-8b6139848766,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c3201b-92') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0ccb498-c5ed-5ba3-8b6e-d3dc5c68cc67', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65c3201b-92, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65c3201b-92, col_values=(('qos', UUID('232f4615-a25d-4234-afed-76d611add699')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65c3201b-92, col_values=(('external_ids', {'iface-id': '65c3201b-92ac-4811-8425-8b6139848766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:5a:a5', 'vm-uuid': '3b055742-c605-41ab-bd40-1a777b8f4e39'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:11 user nova-compute[75216]: INFO os_vif [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:a5,bridge_name='br-int',has_traffic_filtering=True,id=65c3201b-92ac-4811-8425-8b6139848766,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c3201b-92')
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No VIF found with MAC fa:16:3e:9e:5a:a5, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:11 user nova-compute[75216]: INFO nova.compute.claims [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Claim successful on node user
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Creating image(s)
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.380s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:11 user nova-compute[75216]: INFO nova.compute.claims [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Claim successful on node user
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.policy [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf5f940bafbf4fb7aa7ace530f7d10c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baf55600ee343f2b8a6f94622bf9230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.229s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Creating image(s)
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updated VIF entry in instance network info cache for port 65c3201b-92ac-4811-8425-8b6139848766. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updating instance_info_cache with network_info: [{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk 1073741824" returned: 0 in 0.058s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84968b48-03a0-48b9-b10a-b94cd3bcee78 req-00b1b8ed-1ca3-48f7-b0fe-398de419fcec service nova] Releasing lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.policy [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43528060361f4924b8a858bdd2e731cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01690c91146afa3833bea67f8157f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Cannot resize image /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Ensure instance console log exists: /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk 1073741824" returned: 0 in 0.162s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.862s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Cannot resize image /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Ensure instance console log exists: /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Creating image(s)
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "/opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "/opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "/opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG nova.policy [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8929863fd45d4913acd8e30f664344c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35683efd2824c0c9f120badf288862f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.160s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk 1073741824" returned: 0 in 0.051s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.217s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Checking if we can resize image /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Cannot resize image /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Ensure instance console log exists: /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:14 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Successfully created port: a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:14 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Successfully created port: 80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Successfully updated port: a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquired lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Successfully created port: 71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Instance spawned successfully.
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Instance spawned successfully.
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-changed-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Refreshing instance network info cache due to event network-changed-a7dabe6f-d443-44a3-9e79-445efa48e57e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] Acquiring lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:15 user nova-compute[75216]: INFO nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Took 13.92 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:15 user nova-compute[75216]: INFO nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Took 11.94 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:15 user nova-compute[75216]: INFO nova.compute.manager [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Took 15.08 seconds to build instance.
Nov 02 04:43:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92594c67-adf9-4f46-a3dd-5ab7f0ca4373 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.306s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:16 user nova-compute[75216]: INFO nova.compute.manager [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Took 13.28 seconds to build instance.
Nov 02 04:43:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7ce7acf-3a0f-4b21-99b6-c3cf10d6f161 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.519s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updating instance_info_cache with network_info: [{"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Releasing lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Instance network_info: |[{"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] Acquired lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.network.neutron [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Refreshing network info cache for port a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Start _get_guest_xml network_info=[{"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1862184923',display_name='tempest-AttachVolumeNegativeTest-server-1862184923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1862184923',id=4,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECplp6jyJ3m/gYK2wMIBs60NAIzfVmpzZBsWHCdxWHuV3GM2NOYO3FtCL7xpSBQUZgqvhEbnTeYqblXcQKdFYrcOTbZ9abCIILP1CDM/seCTjRw8sHsFl2mW8Z8UVKcqg==',key_name='tempest-keypair-18798171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-5p054bt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=a2b40b8c-5b97-4bf8-adad-647ff27e2bab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:95:58,bridge_name='br-int',has_traffic_filtering=True,id=a7dabe6f-d443-44a3-9e79-445efa48e57e,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dabe6f-d4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'pci_devices' on Instance uuid a2b40b8c-5b97-4bf8-adad-647ff27e2bab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:16 user nova-compute[75216]:   <uuid>a2b40b8c-5b97-4bf8-adad-647ff27e2bab</uuid>
Nov 02 04:43:16 user nova-compute[75216]:   <name>instance-00000004</name>
Nov 02 04:43:16 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:16 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:16 user nova-compute[75216]:   <metadata>
Nov 02 04:43:16 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:16 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:16 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1862184923</nova:name>
Nov 02 04:43:16 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:16</nova:creationTime>
Nov 02 04:43:16 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:16 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:16 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:16 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:16 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:16 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:16 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:16 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:16 user nova-compute[75216]:         <nova:user uuid="43528060361f4924b8a858bdd2e731cc">tempest-AttachVolumeNegativeTest-1766043636-project-member</nova:user>
Nov 02 04:43:16 user nova-compute[75216]:         <nova:project uuid="e1c01690c91146afa3833bea67f8157f">tempest-AttachVolumeNegativeTest-1766043636</nova:project>
Nov 02 04:43:16 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:16 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:16 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:16 user nova-compute[75216]:         <nova:port uuid="a7dabe6f-d443-44a3-9e79-445efa48e57e">
Nov 02 04:43:16 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 04:43:16 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:16 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:16 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:16 user nova-compute[75216]:   </metadata>
Nov 02 04:43:16 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:16 user nova-compute[75216]:     <system>
Nov 02 04:43:16 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:16 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:16 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:16 user nova-compute[75216]:       <entry name="serial">a2b40b8c-5b97-4bf8-adad-647ff27e2bab</entry>
Nov 02 04:43:16 user nova-compute[75216]:       <entry name="uuid">a2b40b8c-5b97-4bf8-adad-647ff27e2bab</entry>
Nov 02 04:43:16 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:16 user nova-compute[75216]:     </system>
Nov 02 04:43:16 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:16 user nova-compute[75216]:   <os>
Nov 02 04:43:16 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:16 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:16 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:16 user nova-compute[75216]:   </os>
Nov 02 04:43:16 user nova-compute[75216]:   <features>
Nov 02 04:43:16 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:16 user nova-compute[75216]:     <apic/>
Nov 02 04:43:16 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:16 user nova-compute[75216]:   </features>
Nov 02 04:43:16 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:16 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:16 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:16 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:16 user nova-compute[75216]:   </clock>
Nov 02 04:43:16 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:16 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:16 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:16 user nova-compute[75216]:   </cpu>
Nov 02 04:43:16 user nova-compute[75216]:   <devices>
Nov 02 04:43:16 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:16 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:16 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk"/>
Nov 02 04:43:16 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:16 user nova-compute[75216]:     </disk>
Nov 02 04:43:16 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:16 user nova-compute[75216]:       <mac address="fa:16:3e:b7:95:58"/>
Nov 02 04:43:16 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:16 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:16 user nova-compute[75216]:       <target dev="tapa7dabe6f-d4"/>
Nov 02 04:43:16 user nova-compute[75216]:     </interface>
Nov 02 04:43:16 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:16 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/console.log" append="off"/>
Nov 02 04:43:16 user nova-compute[75216]:     </serial>
Nov 02 04:43:16 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:16 user nova-compute[75216]:     <video>
Nov 02 04:43:16 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:16 user nova-compute[75216]:     </video>
Nov 02 04:43:16 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:16 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:16 user nova-compute[75216]:     </rng>
Nov 02 04:43:16 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:16 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:16 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:16 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:16 user nova-compute[75216]:   </devices>
Nov 02 04:43:16 user nova-compute[75216]: </domain>
Nov 02 04:43:16 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1862184923',display_name='tempest-AttachVolumeNegativeTest-server-1862184923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1862184923',id=4,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECplp6jyJ3m/gYK2wMIBs60NAIzfVmpzZBsWHCdxWHuV3GM2NOYO3FtCL7xpSBQUZgqvhEbnTeYqblXcQKdFYrcOTbZ9abCIILP1CDM/seCTjRw8sHsFl2mW8Z8UVKcqg==',key_name='tempest-keypair-18798171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-5p054bt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=a2b40b8c-5b97-4bf8-adad-647ff27e2bab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:95:58,bridge_name='br-int',has_traffic_filtering=True,id=a7dabe6f-d443-44a3-9e79-445efa48e57e,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dabe6f-d4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG os_vif [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:95:58,bridge_name='br-int',has_traffic_filtering=True,id=a7dabe6f-d443-44a3-9e79-445efa48e57e,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dabe6f-d4') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76726648-b5ae-536e-9113-5be0ba97b002', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7dabe6f-d4, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7dabe6f-d4, col_values=(('qos', UUID('6fb84528-74b0-4f0f-886b-877f507421c3')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7dabe6f-d4, col_values=(('external_ids', {'iface-id': 'a7dabe6f-d443-44a3-9e79-445efa48e57e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:95:58', 'vm-uuid': 'a2b40b8c-5b97-4bf8-adad-647ff27e2bab'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:16 user nova-compute[75216]: INFO os_vif [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:95:58,bridge_name='br-int',has_traffic_filtering=True,id=a7dabe6f-d443-44a3-9e79-445efa48e57e,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dabe6f-d4')
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No VIF found with MAC fa:16:3e:b7:95:58, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG nova.network.neutron [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updated VIF entry in instance network info cache for port a7dabe6f-d443-44a3-9e79-445efa48e57e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG nova.network.neutron [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updating instance_info_cache with network_info: [{"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c97a9dab-025d-4be7-b7b2-4bcc6c8dfbbe req-62728854-0e4d-4219-ad3a-3ec81e30852e service nova] Releasing lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Successfully updated port: 80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquired lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-changed-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Refreshing instance network info cache due to event network-changed-80407938-aa15-40c0-b5a0-2100f2d9b864. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] Acquiring lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Successfully updated port: 71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquired lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-changed-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Refreshing instance network info cache due to event network-changed-71df5a7f-f774-428f-8f64-138cb2f78152. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] Acquiring lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Releasing lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance network_info: |[{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] Acquired lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Refreshing network info cache for port 80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Start _get_guest_xml network_info=[{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'pci_devices' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:18 user nova-compute[75216]:   <uuid>5405f6de-5da9-475e-9647-7851ca87371d</uuid>
Nov 02 04:43:18 user nova-compute[75216]:   <name>instance-00000003</name>
Nov 02 04:43:18 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:18 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:18 user nova-compute[75216]:   <metadata>
Nov 02 04:43:18 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:18 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:18 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-814331073</nova:name>
Nov 02 04:43:18 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:18</nova:creationTime>
Nov 02 04:43:18 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:18 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:18 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:18 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:18 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:18 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:18 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:18 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:18 user nova-compute[75216]:         <nova:user uuid="cf5f940bafbf4fb7aa7ace530f7d10c1">tempest-AttachVolumeTestJSON-1577581979-project-member</nova:user>
Nov 02 04:43:18 user nova-compute[75216]:         <nova:project uuid="8baf55600ee343f2b8a6f94622bf9230">tempest-AttachVolumeTestJSON-1577581979</nova:project>
Nov 02 04:43:18 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:18 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:18 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:18 user nova-compute[75216]:         <nova:port uuid="80407938-aa15-40c0-b5a0-2100f2d9b864">
Nov 02 04:43:18 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 04:43:18 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:18 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:18 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:18 user nova-compute[75216]:   </metadata>
Nov 02 04:43:18 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:18 user nova-compute[75216]:     <system>
Nov 02 04:43:18 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:18 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:18 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:18 user nova-compute[75216]:       <entry name="serial">5405f6de-5da9-475e-9647-7851ca87371d</entry>
Nov 02 04:43:18 user nova-compute[75216]:       <entry name="uuid">5405f6de-5da9-475e-9647-7851ca87371d</entry>
Nov 02 04:43:18 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:18 user nova-compute[75216]:     </system>
Nov 02 04:43:18 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:18 user nova-compute[75216]:   <os>
Nov 02 04:43:18 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:18 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:18 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:18 user nova-compute[75216]:   </os>
Nov 02 04:43:18 user nova-compute[75216]:   <features>
Nov 02 04:43:18 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:18 user nova-compute[75216]:     <apic/>
Nov 02 04:43:18 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:18 user nova-compute[75216]:   </features>
Nov 02 04:43:18 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:18 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:18 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:18 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:18 user nova-compute[75216]:   </clock>
Nov 02 04:43:18 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:18 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:18 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:18 user nova-compute[75216]:   </cpu>
Nov 02 04:43:18 user nova-compute[75216]:   <devices>
Nov 02 04:43:18 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:18 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:18 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk"/>
Nov 02 04:43:18 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:18 user nova-compute[75216]:     </disk>
Nov 02 04:43:18 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:18 user nova-compute[75216]:       <mac address="fa:16:3e:ba:61:ab"/>
Nov 02 04:43:18 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:18 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:18 user nova-compute[75216]:       <target dev="tap80407938-aa"/>
Nov 02 04:43:18 user nova-compute[75216]:     </interface>
Nov 02 04:43:18 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:18 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/console.log" append="off"/>
Nov 02 04:43:18 user nova-compute[75216]:     </serial>
Nov 02 04:43:18 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:18 user nova-compute[75216]:     <video>
Nov 02 04:43:18 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:18 user nova-compute[75216]:     </video>
Nov 02 04:43:18 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:18 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:18 user nova-compute[75216]:     </rng>
Nov 02 04:43:18 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:18 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:18 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:18 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:18 user nova-compute[75216]:   </devices>
Nov 02 04:43:18 user nova-compute[75216]: </domain>
Nov 02 04:43:18 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG os_vif [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '242fba5d-c742-522b-b846-973745c37886', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80407938-aa, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80407938-aa, col_values=(('qos', UUID('f11c6062-372f-41fb-be0b-9ad3a809833f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80407938-aa, col_values=(('external_ids', {'iface-id': '80407938-aa15-40c0-b5a0-2100f2d9b864', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:61:ab', 'vm-uuid': '5405f6de-5da9-475e-9647-7851ca87371d'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:18 user nova-compute[75216]: INFO os_vif [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa')
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No VIF found with MAC fa:16:3e:ba:61:ab, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updating instance_info_cache with network_info: [{"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Releasing lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Instance network_info: |[{"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] Acquired lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Refreshing network info cache for port 71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Start _get_guest_xml network_info=[{"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2032104718',display_name='tempest-ServerStableDeviceRescueTest-server-2032104718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2032104718',id=5,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMxTLfBZHOz8z7+NKS8lOHqQy7CmLqsWOIx/2iekQeTLJBJ8iUUjqXitlf1SSCgHurhOepyeYrrdl2x3UoJh7BsmLBE8c21PfEBFMl/HM4rU2OevWTtDBumlimhmDKHtw==',key_name='tempest-keypair-169616001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f35683efd2824c0c9f120badf288862f',ramdisk_id='',reservation_id='r-i7yvvq30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1994902459',owner_user_name='tempest-ServerStableDeviceRescueTest-1994902459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8929863fd45d4913acd8e30f664344c7',uuid=096b87b4-307f-4bda-8ad6-f0b0925aae54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Converting VIF {"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b3:00,bridge_name='br-int',has_traffic_filtering=True,id=71df5a7f-f774-428f-8f64-138cb2f78152,network=Network(734db476-6358-45cd-8739-5acf10fa631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71df5a7f-f7') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lazy-loading 'pci_devices' on Instance uuid 096b87b4-307f-4bda-8ad6-f0b0925aae54 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:19 user nova-compute[75216]:   <uuid>096b87b4-307f-4bda-8ad6-f0b0925aae54</uuid>
Nov 02 04:43:19 user nova-compute[75216]:   <name>instance-00000005</name>
Nov 02 04:43:19 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:19 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:19 user nova-compute[75216]:   <metadata>
Nov 02 04:43:19 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:19 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:19 user nova-compute[75216]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2032104718</nova:name>
Nov 02 04:43:19 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:18</nova:creationTime>
Nov 02 04:43:19 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:19 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:19 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:19 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:19 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:19 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:19 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:19 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:19 user nova-compute[75216]:         <nova:user uuid="8929863fd45d4913acd8e30f664344c7">tempest-ServerStableDeviceRescueTest-1994902459-project-member</nova:user>
Nov 02 04:43:19 user nova-compute[75216]:         <nova:project uuid="f35683efd2824c0c9f120badf288862f">tempest-ServerStableDeviceRescueTest-1994902459</nova:project>
Nov 02 04:43:19 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:19 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:19 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:19 user nova-compute[75216]:         <nova:port uuid="71df5a7f-f774-428f-8f64-138cb2f78152">
Nov 02 04:43:19 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:43:19 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:19 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:19 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:19 user nova-compute[75216]:   </metadata>
Nov 02 04:43:19 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:19 user nova-compute[75216]:     <system>
Nov 02 04:43:19 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:19 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:19 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:19 user nova-compute[75216]:       <entry name="serial">096b87b4-307f-4bda-8ad6-f0b0925aae54</entry>
Nov 02 04:43:19 user nova-compute[75216]:       <entry name="uuid">096b87b4-307f-4bda-8ad6-f0b0925aae54</entry>
Nov 02 04:43:19 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:19 user nova-compute[75216]:     </system>
Nov 02 04:43:19 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:19 user nova-compute[75216]:   <os>
Nov 02 04:43:19 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:19 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:19 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:19 user nova-compute[75216]:   </os>
Nov 02 04:43:19 user nova-compute[75216]:   <features>
Nov 02 04:43:19 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:19 user nova-compute[75216]:     <apic/>
Nov 02 04:43:19 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:19 user nova-compute[75216]:   </features>
Nov 02 04:43:19 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:19 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:19 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:19 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:19 user nova-compute[75216]:   </clock>
Nov 02 04:43:19 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:19 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:19 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:19 user nova-compute[75216]:   </cpu>
Nov 02 04:43:19 user nova-compute[75216]:   <devices>
Nov 02 04:43:19 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:19 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:19 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk"/>
Nov 02 04:43:19 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:19 user nova-compute[75216]:     </disk>
Nov 02 04:43:19 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:19 user nova-compute[75216]:       <mac address="fa:16:3e:b3:b3:00"/>
Nov 02 04:43:19 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:19 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:19 user nova-compute[75216]:       <target dev="tap71df5a7f-f7"/>
Nov 02 04:43:19 user nova-compute[75216]:     </interface>
Nov 02 04:43:19 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:19 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/console.log" append="off"/>
Nov 02 04:43:19 user nova-compute[75216]:     </serial>
Nov 02 04:43:19 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:19 user nova-compute[75216]:     <video>
Nov 02 04:43:19 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:19 user nova-compute[75216]:     </video>
Nov 02 04:43:19 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:19 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:19 user nova-compute[75216]:     </rng>
Nov 02 04:43:19 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:19 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:19 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:19 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:19 user nova-compute[75216]:   </devices>
Nov 02 04:43:19 user nova-compute[75216]: </domain>
Nov 02 04:43:19 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2032104718',display_name='tempest-ServerStableDeviceRescueTest-server-2032104718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2032104718',id=5,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMxTLfBZHOz8z7+NKS8lOHqQy7CmLqsWOIx/2iekQeTLJBJ8iUUjqXitlf1SSCgHurhOepyeYrrdl2x3UoJh7BsmLBE8c21PfEBFMl/HM4rU2OevWTtDBumlimhmDKHtw==',key_name='tempest-keypair-169616001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f35683efd2824c0c9f120badf288862f',ramdisk_id='',reservation_id='r-i7yvvq30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1994902459',owner_user_name='tempest-ServerStableDeviceRescueTest-1994902459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8929863fd45d4913acd8e30f664344c7',uuid=096b87b4-307f-4bda-8ad6-f0b0925aae54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Converting VIF {"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b3:00,bridge_name='br-int',has_traffic_filtering=True,id=71df5a7f-f774-428f-8f64-138cb2f78152,network=Network(734db476-6358-45cd-8739-5acf10fa631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71df5a7f-f7') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG os_vif [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b3:00,bridge_name='br-int',has_traffic_filtering=True,id=71df5a7f-f774-428f-8f64-138cb2f78152,network=Network(734db476-6358-45cd-8739-5acf10fa631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71df5a7f-f7') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '724117bf-5571-58ae-8bb7-5942d36f5287', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71df5a7f-f7, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71df5a7f-f7, col_values=(('qos', UUID('7be64dc7-0019-4b74-b908-7d0b7c7af5b8')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71df5a7f-f7, col_values=(('external_ids', {'iface-id': '71df5a7f-f774-428f-8f64-138cb2f78152', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:b3:00', 'vm-uuid': '096b87b4-307f-4bda-8ad6-f0b0925aae54'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:19 user nova-compute[75216]: INFO os_vif [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b3:00,bridge_name='br-int',has_traffic_filtering=True,id=71df5a7f-f774-428f-8f64-138cb2f78152,network=Network(734db476-6358-45cd-8739-5acf10fa631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71df5a7f-f7')
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] No VIF found with MAC fa:16:3e:b3:b3:00, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updated VIF entry in instance network info cache for port 80407938-aa15-40c0-b5a0-2100f2d9b864. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-136f6e7d-5c70-48cb-b4cf-914e1a074a18 req-2936ccdf-5928-4f7c-be6c-5aec0b33c566 service nova] Releasing lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updated VIF entry in instance network info cache for port 71df5a7f-f774-428f-8f64-138cb2f78152. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updating instance_info_cache with network_info: [{"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b8c67ae-63bc-4da5-92b9-fa4eb5927e36 req-4dde2085-fd6c-4d02-b722-68405a52a6a0 service nova] Releasing lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Instance spawned successfully.
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:21 user nova-compute[75216]: INFO nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Took 9.83 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:22 user nova-compute[75216]: INFO nova.compute.manager [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Took 10.87 seconds to build instance.
Nov 02 04:43:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e823de36-623a-4b49-bac3-0fd9b92195d0 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.118s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance spawned successfully.
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Instance spawned successfully.
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:26 user nova-compute[75216]: INFO nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Took 15.02 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:26 user nova-compute[75216]: INFO nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Took 13.67 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:26 user nova-compute[75216]: INFO nova.compute.manager [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Took 16.16 seconds to build instance.
Nov 02 04:43:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f545024-80aa-4f43-9939-531b14fd4021 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.317s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:26 user nova-compute[75216]: INFO nova.compute.manager [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Took 15.73 seconds to build instance.
Nov 02 04:43:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e454bbfd-88a7-415f-8c59-34f410545a53 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.926s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:28 user nova-compute[75216]: INFO nova.compute.claims [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Claim successful on node user
Nov 02 04:43:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG nova.policy [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '489d874c60324c1b828e643f43a90beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672b35fe5f6c43dc95669b228d81dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Creating image(s)
Nov 02 04:43:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "/opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "/opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "fe59fb0297d1ed6a3806caee29e99b1183292ec9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "fe59fb0297d1ed6a3806caee29e99b1183292ec9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.part --force-share --output=json" returned: 0 in 0.305s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG nova.virt.images [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] a8f135eb-1725-411b-a11b-d10614b7e55f was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.part /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Successfully created port: 8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.part /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.converted" returned: 0 in 0.232s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9.converted --force-share --output=json" returned: 0 in 0.369s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "fe59fb0297d1ed6a3806caee29e99b1183292ec9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.507s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "fe59fb0297d1ed6a3806caee29e99b1183292ec9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "fe59fb0297d1ed6a3806caee29e99b1183292ec9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9 --force-share --output=json" returned: 0 in 0.255s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9,backing_fmt=raw /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9,backing_fmt=raw /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk 1073741824" returned: 0 in 0.064s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "fe59fb0297d1ed6a3806caee29e99b1183292ec9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9 --force-share --output=json" returned: 0 in 0.314s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Successfully updated port: 8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquired lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-changed-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Refreshing instance network info cache due to event network-changed-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] Acquiring lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Updating instance_info_cache with network_info: [{"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Releasing lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Instance network_info: |[{"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] Acquired lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Refreshing network info cache for port 8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Start _get_guest_xml network_info=[{"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:43:18Z,direct_url=<?>,disk_format='qcow2',id=a8f135eb-1725-411b-a11b-d10614b7e55f,min_disk=0,min_ram=0,name='',owner='c930018d6d0a4906acf209447def86f8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:43:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/sda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a8f135eb-1725-411b-a11b-d10614b7e55f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:43:18Z,direct_url=<?>,disk_format='qcow2',id=a8f135eb-1725-411b-a11b-d10614b7e55f,min_disk=0,min_ram=0,name='',owner='c930018d6d0a4906acf209447def86f8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:43:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1957199507',display_name='tempest-AttachSCSIVolumeTestJSON-server-1957199507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1957199507',id=6,image_ref='a8f135eb-1725-411b-a11b-d10614b7e55f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4aGED9Y2aGpBY3Bc1U6xN5rHWQHPReY32kFfEBLArbXg3Z9MDeCRFRZL0iNkd7EovAaQnt58rSQtfdSseDmeDgGxBRimRUs8uNZo4TEc43TTRX8TgTdS2Xx/Ho/LjyUw==',key_name='tempest-keypair-1136540460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672b35fe5f6c43dc95669b228d81dea0',ramdisk_id='',reservation_id='r-vhm7i1wx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a8f135eb-1725-411b-a11b-d10614b7e55f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580495815',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580495815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='489d874c60324c1b828e643f43a90beb',uuid=2bf23601-af5f-4d48-a99a-74230fb02935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Converting VIF {"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:93:46,bridge_name='br-int',has_traffic_filtering=True,id=8f26575a-4e2a-4198-98a9-7fc67e5cfe0f,network=Network(fddf7dce-a96d-4937-a4b5-961cae9cbec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f26575a-4e') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf23601-af5f-4d48-a99a-74230fb02935 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:33 user nova-compute[75216]:   <uuid>2bf23601-af5f-4d48-a99a-74230fb02935</uuid>
Nov 02 04:43:33 user nova-compute[75216]:   <name>instance-00000006</name>
Nov 02 04:43:33 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:33 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:33 user nova-compute[75216]:   <metadata>
Nov 02 04:43:33 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:33 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:33 user nova-compute[75216]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1957199507</nova:name>
Nov 02 04:43:33 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:33</nova:creationTime>
Nov 02 04:43:33 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:33 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:33 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:33 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:33 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:33 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:33 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:33 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:33 user nova-compute[75216]:         <nova:user uuid="489d874c60324c1b828e643f43a90beb">tempest-AttachSCSIVolumeTestJSON-580495815-project-member</nova:user>
Nov 02 04:43:33 user nova-compute[75216]:         <nova:project uuid="672b35fe5f6c43dc95669b228d81dea0">tempest-AttachSCSIVolumeTestJSON-580495815</nova:project>
Nov 02 04:43:33 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:33 user nova-compute[75216]:       <nova:root type="image" uuid="a8f135eb-1725-411b-a11b-d10614b7e55f"/>
Nov 02 04:43:33 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:33 user nova-compute[75216]:         <nova:port uuid="8f26575a-4e2a-4198-98a9-7fc67e5cfe0f">
Nov 02 04:43:33 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 04:43:33 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:33 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:33 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:33 user nova-compute[75216]:   </metadata>
Nov 02 04:43:33 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:33 user nova-compute[75216]:     <system>
Nov 02 04:43:33 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:33 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:33 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:33 user nova-compute[75216]:       <entry name="serial">2bf23601-af5f-4d48-a99a-74230fb02935</entry>
Nov 02 04:43:33 user nova-compute[75216]:       <entry name="uuid">2bf23601-af5f-4d48-a99a-74230fb02935</entry>
Nov 02 04:43:33 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:33 user nova-compute[75216]:     </system>
Nov 02 04:43:33 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:33 user nova-compute[75216]:   <os>
Nov 02 04:43:33 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:33 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:33 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:33 user nova-compute[75216]:   </os>
Nov 02 04:43:33 user nova-compute[75216]:   <features>
Nov 02 04:43:33 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:33 user nova-compute[75216]:     <apic/>
Nov 02 04:43:33 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:33 user nova-compute[75216]:   </features>
Nov 02 04:43:33 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:33 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:33 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:33 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:33 user nova-compute[75216]:   </clock>
Nov 02 04:43:33 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:33 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:33 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:33 user nova-compute[75216]:   </cpu>
Nov 02 04:43:33 user nova-compute[75216]:   <devices>
Nov 02 04:43:33 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:33 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:33 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk"/>
Nov 02 04:43:33 user nova-compute[75216]:       <target dev="sda" bus="scsi"/>
Nov 02 04:43:33 user nova-compute[75216]:       <address type="drive" controller="0" unit="0"/>
Nov 02 04:43:33 user nova-compute[75216]:     </disk>
Nov 02 04:43:33 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 02 04:43:33 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 04:43:33 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk.config"/>
Nov 02 04:43:33 user nova-compute[75216]:       <target dev="sdb" bus="scsi"/>
Nov 02 04:43:33 user nova-compute[75216]:       <address type="drive" controller="0" unit="1"/>
Nov 02 04:43:33 user nova-compute[75216]:     </disk>
Nov 02 04:43:33 user nova-compute[75216]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 02 04:43:33 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:33 user nova-compute[75216]:       <mac address="fa:16:3e:f5:93:46"/>
Nov 02 04:43:33 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:33 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:33 user nova-compute[75216]:       <target dev="tap8f26575a-4e"/>
Nov 02 04:43:33 user nova-compute[75216]:     </interface>
Nov 02 04:43:33 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:33 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/console.log" append="off"/>
Nov 02 04:43:33 user nova-compute[75216]:     </serial>
Nov 02 04:43:33 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:33 user nova-compute[75216]:     <video>
Nov 02 04:43:33 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:33 user nova-compute[75216]:     </video>
Nov 02 04:43:33 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:33 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:33 user nova-compute[75216]:     </rng>
Nov 02 04:43:33 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:33 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:33 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:33 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:33 user nova-compute[75216]:   </devices>
Nov 02 04:43:33 user nova-compute[75216]: </domain>
Nov 02 04:43:33 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1957199507',display_name='tempest-AttachSCSIVolumeTestJSON-server-1957199507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1957199507',id=6,image_ref='a8f135eb-1725-411b-a11b-d10614b7e55f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4aGED9Y2aGpBY3Bc1U6xN5rHWQHPReY32kFfEBLArbXg3Z9MDeCRFRZL0iNkd7EovAaQnt58rSQtfdSseDmeDgGxBRimRUs8uNZo4TEc43TTRX8TgTdS2Xx/Ho/LjyUw==',key_name='tempest-keypair-1136540460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672b35fe5f6c43dc95669b228d81dea0',ramdisk_id='',reservation_id='r-vhm7i1wx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a8f135eb-1725-411b-a11b-d10614b7e55f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580495815',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580495815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='489d874c60324c1b828e643f43a90beb',uuid=2bf23601-af5f-4d48-a99a-74230fb02935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Converting VIF {"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:93:46,bridge_name='br-int',has_traffic_filtering=True,id=8f26575a-4e2a-4198-98a9-7fc67e5cfe0f,network=Network(fddf7dce-a96d-4937-a4b5-961cae9cbec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f26575a-4e') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG os_vif [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:93:46,bridge_name='br-int',has_traffic_filtering=True,id=8f26575a-4e2a-4198-98a9-7fc67e5cfe0f,network=Network(fddf7dce-a96d-4937-a4b5-961cae9cbec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f26575a-4e') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb68fd73-49ba-5170-a38d-81e729895d48', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f26575a-4e, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f26575a-4e, col_values=(('qos', UUID('4761ad17-ada5-4a62-b339-133eac2c7cc2')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f26575a-4e, col_values=(('external_ids', {'iface-id': '8f26575a-4e2a-4198-98a9-7fc67e5cfe0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:93:46', 'vm-uuid': '2bf23601-af5f-4d48-a99a-74230fb02935'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:33 user nova-compute[75216]: INFO os_vif [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:93:46,bridge_name='br-int',has_traffic_filtering=True,id=8f26575a-4e2a-4198-98a9-7fc67e5cfe0f,network=Network(fddf7dce-a96d-4937-a4b5-961cae9cbec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f26575a-4e')
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] No BDM found with device name sda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] No VIF found with MAC fa:16:3e:f5:93:46, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Using config drive
Nov 02 04:43:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Creating config drive at /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk.config
Nov 02 04:43:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptvm5xlpq {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptvm5xlpq" returned: 0 in 0.072s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-758d536b-88c9-403c-91ec-58807db1f1a9 req-ae11457b-52e8-4adb-a243-b286712e6d90 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-758d536b-88c9-403c-91ec-58807db1f1a9 req-ae11457b-52e8-4adb-a243-b286712e6d90 service nova] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-758d536b-88c9-403c-91ec-58807db1f1a9 req-ae11457b-52e8-4adb-a243-b286712e6d90 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-758d536b-88c9-403c-91ec-58807db1f1a9 req-ae11457b-52e8-4adb-a243-b286712e6d90 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-758d536b-88c9-403c-91ec-58807db1f1a9 req-ae11457b-52e8-4adb-a243-b286712e6d90 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] No waiting events found dispatching network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:35 user nova-compute[75216]: WARNING nova.compute.manager [req-758d536b-88c9-403c-91ec-58807db1f1a9 req-ae11457b-52e8-4adb-a243-b286712e6d90 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received unexpected event network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e for instance with vm_state active and task_state None.
Nov 02 04:43:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Updated VIF entry in instance network info cache for port 8f26575a-4e2a-4198-98a9-7fc67e5cfe0f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Updating instance_info_cache with network_info: [{"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ade38e2-3e9b-4260-9ae1-2aa13c58aa40 req-77ded05d-4bc7-43ff-9a3c-853e1d040953 service nova] Releasing lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-6babfbba-f57d-4493-a2ec-af252e2649da req-7c6c0066-a85d-4179-b1a7-cc036ba17f4f service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6babfbba-f57d-4493-a2ec-af252e2649da req-7c6c0066-a85d-4179-b1a7-cc036ba17f4f service nova] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6babfbba-f57d-4493-a2ec-af252e2649da req-7c6c0066-a85d-4179-b1a7-cc036ba17f4f service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6babfbba-f57d-4493-a2ec-af252e2649da req-7c6c0066-a85d-4179-b1a7-cc036ba17f4f service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-6babfbba-f57d-4493-a2ec-af252e2649da req-7c6c0066-a85d-4179-b1a7-cc036ba17f4f service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] No waiting events found dispatching network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:36 user nova-compute[75216]: WARNING nova.compute.manager [req-6babfbba-f57d-4493-a2ec-af252e2649da req-7c6c0066-a85d-4179-b1a7-cc036ba17f4f service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received unexpected event network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f for instance with vm_state building and task_state spawning.
Nov 02 04:43:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-f23d2871-0b9e-4700-b093-b363db153dbc req-b287737a-c513-4602-a554-01c3596a94d7 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f23d2871-0b9e-4700-b093-b363db153dbc req-b287737a-c513-4602-a554-01c3596a94d7 service nova] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f23d2871-0b9e-4700-b093-b363db153dbc req-b287737a-c513-4602-a554-01c3596a94d7 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f23d2871-0b9e-4700-b093-b363db153dbc req-b287737a-c513-4602-a554-01c3596a94d7 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-f23d2871-0b9e-4700-b093-b363db153dbc req-b287737a-c513-4602-a554-01c3596a94d7 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] No waiting events found dispatching network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:37 user nova-compute[75216]: WARNING nova.compute.manager [req-f23d2871-0b9e-4700-b093-b363db153dbc req-b287737a-c513-4602-a554-01c3596a94d7 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received unexpected event network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e for instance with vm_state active and task_state None.
Nov 02 04:43:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-4ec6850d-75ec-4e51-9567-f2ec230b0eb2 req-db6e0bf7-9f26-4cc9-9a05-4c1262ada791 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ec6850d-75ec-4e51-9567-f2ec230b0eb2 req-db6e0bf7-9f26-4cc9-9a05-4c1262ada791 service nova] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ec6850d-75ec-4e51-9567-f2ec230b0eb2 req-db6e0bf7-9f26-4cc9-9a05-4c1262ada791 service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ec6850d-75ec-4e51-9567-f2ec230b0eb2 req-db6e0bf7-9f26-4cc9-9a05-4c1262ada791 service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-4ec6850d-75ec-4e51-9567-f2ec230b0eb2 req-db6e0bf7-9f26-4cc9-9a05-4c1262ada791 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] No waiting events found dispatching network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:38 user nova-compute[75216]: WARNING nova.compute.manager [req-4ec6850d-75ec-4e51-9567-f2ec230b0eb2 req-db6e0bf7-9f26-4cc9-9a05-4c1262ada791 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received unexpected event network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f for instance with vm_state building and task_state spawning.
Nov 02 04:43:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:39 user nova-compute[75216]: INFO nova.compute.claims [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Claim successful on node user
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Instance spawned successfully.
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:39 user nova-compute[75216]: INFO nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Took 10.22 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:39 user nova-compute[75216]: INFO nova.compute.manager [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Took 11.46 seconds to build instance.
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6ae4e2ca-aacb-4c50-aa5f-0deeb0e3b78e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.802s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG nova.policy [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0544ce72c149454ebea470afdebf777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db9bb5dbed54b22b9144e4fc46e2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Creating image(s)
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.315s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.281s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Successfully created port: 9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk 1073741824" returned: 0 in 0.076s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.253s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Cannot resize image /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Ensure instance console log exists: /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Successfully updated port: 9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquired lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-changed-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Refreshing instance network info cache due to event network-changed-9df687c6-2d85-4a7f-9afc-be274cd71afd. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] Acquiring lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Releasing lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Instance network_info: |[{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] Acquired lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Refreshing network info cache for port 9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Start _get_guest_xml network_info=[{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:42 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:42 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converting VIF {"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:68:27,bridge_name='br-int',has_traffic_filtering=True,id=9df687c6-2d85-4a7f-9afc-be274cd71afd,network=Network(b38fcf0a-e4ec-421d-b58a-99ea86f79f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df687c6-2d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.objects.instance [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'pci_devices' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:42 user nova-compute[75216]:   <uuid>521d9190-7056-42d2-a594-d1ae11b37798</uuid>
Nov 02 04:43:42 user nova-compute[75216]:   <name>instance-00000007</name>
Nov 02 04:43:42 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:42 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:42 user nova-compute[75216]:   <metadata>
Nov 02 04:43:42 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:42 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:42 user nova-compute[75216]:       <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:43:42 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:42</nova:creationTime>
Nov 02 04:43:42 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:42 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:42 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:42 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:42 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:42 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:42 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:42 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:42 user nova-compute[75216]:         <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:43:42 user nova-compute[75216]:         <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:43:42 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:42 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:42 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:42 user nova-compute[75216]:         <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:43:42 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:43:42 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:42 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:42 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:42 user nova-compute[75216]:   </metadata>
Nov 02 04:43:42 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:42 user nova-compute[75216]:     <system>
Nov 02 04:43:42 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:42 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:42 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:42 user nova-compute[75216]:       <entry name="serial">521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:43:42 user nova-compute[75216]:       <entry name="uuid">521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:43:42 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:42 user nova-compute[75216]:     </system>
Nov 02 04:43:42 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:42 user nova-compute[75216]:   <os>
Nov 02 04:43:42 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:42 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:42 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:42 user nova-compute[75216]:   </os>
Nov 02 04:43:42 user nova-compute[75216]:   <features>
Nov 02 04:43:42 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:42 user nova-compute[75216]:     <apic/>
Nov 02 04:43:42 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:42 user nova-compute[75216]:   </features>
Nov 02 04:43:42 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:42 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:42 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:42 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:42 user nova-compute[75216]:   </clock>
Nov 02 04:43:42 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:42 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:42 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:42 user nova-compute[75216]:   </cpu>
Nov 02 04:43:42 user nova-compute[75216]:   <devices>
Nov 02 04:43:42 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:42 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:42 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk"/>
Nov 02 04:43:42 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:42 user nova-compute[75216]:     </disk>
Nov 02 04:43:42 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 02 04:43:42 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 04:43:42 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config"/>
Nov 02 04:43:42 user nova-compute[75216]:       <target dev="hda" bus="ide"/>
Nov 02 04:43:42 user nova-compute[75216]:     </disk>
Nov 02 04:43:42 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:42 user nova-compute[75216]:       <mac address="fa:16:3e:a1:68:27"/>
Nov 02 04:43:42 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:42 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:42 user nova-compute[75216]:       <target dev="tap9df687c6-2d"/>
Nov 02 04:43:42 user nova-compute[75216]:     </interface>
Nov 02 04:43:42 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:42 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log" append="off"/>
Nov 02 04:43:42 user nova-compute[75216]:     </serial>
Nov 02 04:43:42 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:42 user nova-compute[75216]:     <video>
Nov 02 04:43:42 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:42 user nova-compute[75216]:     </video>
Nov 02 04:43:42 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:42 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:42 user nova-compute[75216]:     </rng>
Nov 02 04:43:42 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:42 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:42 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:42 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:42 user nova-compute[75216]:   </devices>
Nov 02 04:43:42 user nova-compute[75216]: </domain>
Nov 02 04:43:42 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converting VIF {"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:68:27,bridge_name='br-int',has_traffic_filtering=True,id=9df687c6-2d85-4a7f-9afc-be274cd71afd,network=Network(b38fcf0a-e4ec-421d-b58a-99ea86f79f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df687c6-2d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG os_vif [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:68:27,bridge_name='br-int',has_traffic_filtering=True,id=9df687c6-2d85-4a7f-9afc-be274cd71afd,network=Network(b38fcf0a-e4ec-421d-b58a-99ea86f79f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df687c6-2d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae9bb57f-68d7-5f74-ba89-0234e13dbc36', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9df687c6-2d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9df687c6-2d, col_values=(('qos', UUID('dc924984-88eb-4d12-88db-04da7043d7a5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9df687c6-2d, col_values=(('external_ids', {'iface-id': '9df687c6-2d85-4a7f-9afc-be274cd71afd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:68:27', 'vm-uuid': '521d9190-7056-42d2-a594-d1ae11b37798'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:42 user nova-compute[75216]: INFO os_vif [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:68:27,bridge_name='br-int',has_traffic_filtering=True,id=9df687c6-2d85-4a7f-9afc-be274cd71afd,network=Network(b38fcf0a-e4ec-421d-b58a-99ea86f79f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df687c6-2d')
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No VIF found with MAC fa:16:3e:a1:68:27, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Using config drive
Nov 02 04:43:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Creating config drive at /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config
Nov 02 04:43:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwfwxqcjy {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwfwxqcjy" returned: 0 in 0.070s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updated VIF entry in instance network info cache for port 9df687c6-2d85-4a7f-9afc-be274cd71afd. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-07218b3e-cda0-44ac-8d4b-d7989a620a95 req-f3e0355e-bd26-4061-bb23-2ce902d9d010 service nova] Releasing lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0ebcc9b-32e7-4d85-a646-7bb35f45f827 req-47737ab3-93f7-4e5d-9c69-43899420673f service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received event network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0ebcc9b-32e7-4d85-a646-7bb35f45f827 req-47737ab3-93f7-4e5d-9c69-43899420673f service nova] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0ebcc9b-32e7-4d85-a646-7bb35f45f827 req-47737ab3-93f7-4e5d-9c69-43899420673f service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0ebcc9b-32e7-4d85-a646-7bb35f45f827 req-47737ab3-93f7-4e5d-9c69-43899420673f service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0ebcc9b-32e7-4d85-a646-7bb35f45f827 req-47737ab3-93f7-4e5d-9c69-43899420673f service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] No waiting events found dispatching network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:45 user nova-compute[75216]: WARNING nova.compute.manager [req-d0ebcc9b-32e7-4d85-a646-7bb35f45f827 req-47737ab3-93f7-4e5d-9c69-43899420673f service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received unexpected event network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c for instance with vm_state active and task_state None.
Nov 02 04:43:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received event network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] No waiting events found dispatching network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:47 user nova-compute[75216]: WARNING nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received unexpected event network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c for instance with vm_state active and task_state None.
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received event network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] No waiting events found dispatching network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:47 user nova-compute[75216]: WARNING nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received unexpected event network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 for instance with vm_state active and task_state None.
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received event network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] No waiting events found dispatching network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:47 user nova-compute[75216]: WARNING nova.compute.manager [req-5b50e2ed-36cf-41f9-9fcb-0a11c835a411 req-37bb9457-2150-4032-aa3a-0e61274934ce service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received unexpected event network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 for instance with vm_state active and task_state None.
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Instance spawned successfully.
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:47 user nova-compute[75216]: INFO nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Took 7.50 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:47 user nova-compute[75216]: INFO nova.compute.manager [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Took 8.78 seconds to build instance.
Nov 02 04:43:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-13ffb7ae-1189-43da-9a22-1e0c0c6f5059 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.914s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3448d4c-df6e-4f42-9e9f-42330907fcec req-96d662ad-9aa2-468e-b0f9-f4ebffe18c98 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3448d4c-df6e-4f42-9e9f-42330907fcec req-96d662ad-9aa2-468e-b0f9-f4ebffe18c98 service nova] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3448d4c-df6e-4f42-9e9f-42330907fcec req-96d662ad-9aa2-468e-b0f9-f4ebffe18c98 service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3448d4c-df6e-4f42-9e9f-42330907fcec req-96d662ad-9aa2-468e-b0f9-f4ebffe18c98 service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3448d4c-df6e-4f42-9e9f-42330907fcec req-96d662ad-9aa2-468e-b0f9-f4ebffe18c98 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] No waiting events found dispatching network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:48 user nova-compute[75216]: WARNING nova.compute.manager [req-b3448d4c-df6e-4f42-9e9f-42330907fcec req-96d662ad-9aa2-468e-b0f9-f4ebffe18c98 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received unexpected event network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 for instance with vm_state active and task_state None.
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:49 user nova-compute[75216]: INFO nova.compute.claims [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Claim successful on node user
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:43:49 user nova-compute[75216]: INFO nova.compute.claims [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Claim successful on node user
Nov 02 04:43:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:49 user nova-compute[75216]: DEBUG nova.policy [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59d9304af0ca46b9beb5132cbe5c0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc748dbc75f04202b94f1d25c4e79f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Creating image(s)
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "/opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "/opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "/opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.272s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk 1073741824" returned: 0 in 0.064s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-552c060f-8ef8-4560-8e85-5994db1430a2 req-d4ad782c-3e23-4faf-8691-5bd753042bbd service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-552c060f-8ef8-4560-8e85-5994db1430a2 req-d4ad782c-3e23-4faf-8691-5bd753042bbd service nova] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-552c060f-8ef8-4560-8e85-5994db1430a2 req-d4ad782c-3e23-4faf-8691-5bd753042bbd service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-552c060f-8ef8-4560-8e85-5994db1430a2 req-d4ad782c-3e23-4faf-8691-5bd753042bbd service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-552c060f-8ef8-4560-8e85-5994db1430a2 req-d4ad782c-3e23-4faf-8691-5bd753042bbd service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] No waiting events found dispatching network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:50 user nova-compute[75216]: WARNING nova.compute.manager [req-552c060f-8ef8-4560-8e85-5994db1430a2 req-d4ad782c-3e23-4faf-8691-5bd753042bbd service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received unexpected event network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 for instance with vm_state active and task_state None.
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:43:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.policy [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f58f2ef909547e28317c0986dae386b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecaf1abaeeb43efb28629a65c00a7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.250s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:43:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Creating image(s)
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "/opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "/opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "/opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Successfully created port: 04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Cannot resize image /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Ensure instance console log exists: /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.288s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.216s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk 1073741824" returned: 0 in 0.068s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Successfully created port: 9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.267s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:43:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Cannot resize image /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Ensure instance console log exists: /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Successfully updated port: 04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquired lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-changed-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Refreshing instance network info cache due to event network-changed-04233350-adb4-44b1-9121-0ec06fd9b577. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] Acquiring lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Successfully updated port: 9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquired lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updating instance_info_cache with network_info: [{"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Releasing lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Instance network_info: |[{"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] Acquired lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Refreshing network info cache for port 04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Start _get_guest_xml network_info=[{"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-810450363',display_name='tempest-VolumesAssistedSnapshotsTest-server-810450363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-810450363',id=8,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1v55wJRuxakxzr5eZE7vGNaEBQQvAYs8IQxrL3v37z8TwB99o6LQGoRZP48nOp0r3FhyckvuVX0PmFa1HPds95yzVlJzHUpvj8cIRt9axbt/igX+XbZrx6t6vac7IChg==',key_name='tempest-keypair-1067127104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc748dbc75f04202b94f1d25c4e79f98',ramdisk_id='',reservation_id='r-ogcfm652',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1716857785',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1716857785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59d9304af0ca46b9beb5132cbe5c0ce9',uuid=faf3ef57-71fb-4ba2-a817-497c40f649a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Converting VIF {"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=04233350-adb4-44b1-9121-0ec06fd9b577,network=Network(9e63955d-b28f-4b0e-a0de-087239533469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04233350-ad') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lazy-loading 'pci_devices' on Instance uuid faf3ef57-71fb-4ba2-a817-497c40f649a0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:53 user nova-compute[75216]:   <uuid>faf3ef57-71fb-4ba2-a817-497c40f649a0</uuid>
Nov 02 04:43:53 user nova-compute[75216]:   <name>instance-00000008</name>
Nov 02 04:43:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:53 user nova-compute[75216]:   <metadata>
Nov 02 04:43:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-810450363</nova:name>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:52</nova:creationTime>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:53 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:user uuid="59d9304af0ca46b9beb5132cbe5c0ce9">tempest-VolumesAssistedSnapshotsTest-1716857785-project-member</nova:user>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:project uuid="bc748dbc75f04202b94f1d25c4e79f98">tempest-VolumesAssistedSnapshotsTest-1716857785</nova:project>
Nov 02 04:43:53 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:port uuid="04233350-adb4-44b1-9121-0ec06fd9b577">
Nov 02 04:43:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:43:53 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:53 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:53 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:53 user nova-compute[75216]:   </metadata>
Nov 02 04:43:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:53 user nova-compute[75216]:     <system>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="serial">faf3ef57-71fb-4ba2-a817-497c40f649a0</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="uuid">faf3ef57-71fb-4ba2-a817-497c40f649a0</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:53 user nova-compute[75216]:     </system>
Nov 02 04:43:53 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:53 user nova-compute[75216]:   <os>
Nov 02 04:43:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:53 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:53 user nova-compute[75216]:   </os>
Nov 02 04:43:53 user nova-compute[75216]:   <features>
Nov 02 04:43:53 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:53 user nova-compute[75216]:     <apic/>
Nov 02 04:43:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:53 user nova-compute[75216]:   </features>
Nov 02 04:43:53 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:53 user nova-compute[75216]:   </clock>
Nov 02 04:43:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:53 user nova-compute[75216]:   </cpu>
Nov 02 04:43:53 user nova-compute[75216]:   <devices>
Nov 02 04:43:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk"/>
Nov 02 04:43:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:53 user nova-compute[75216]:     </disk>
Nov 02 04:43:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:53 user nova-compute[75216]:       <mac address="fa:16:3e:4d:5d:bb"/>
Nov 02 04:43:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:53 user nova-compute[75216]:       <target dev="tap04233350-ad"/>
Nov 02 04:43:53 user nova-compute[75216]:     </interface>
Nov 02 04:43:53 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/console.log" append="off"/>
Nov 02 04:43:53 user nova-compute[75216]:     </serial>
Nov 02 04:43:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:53 user nova-compute[75216]:     <video>
Nov 02 04:43:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:53 user nova-compute[75216]:     </video>
Nov 02 04:43:53 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:53 user nova-compute[75216]:     </rng>
Nov 02 04:43:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:53 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:53 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:53 user nova-compute[75216]:   </devices>
Nov 02 04:43:53 user nova-compute[75216]: </domain>
Nov 02 04:43:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-810450363',display_name='tempest-VolumesAssistedSnapshotsTest-server-810450363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-810450363',id=8,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1v55wJRuxakxzr5eZE7vGNaEBQQvAYs8IQxrL3v37z8TwB99o6LQGoRZP48nOp0r3FhyckvuVX0PmFa1HPds95yzVlJzHUpvj8cIRt9axbt/igX+XbZrx6t6vac7IChg==',key_name='tempest-keypair-1067127104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc748dbc75f04202b94f1d25c4e79f98',ramdisk_id='',reservation_id='r-ogcfm652',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1716857785',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1716857785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59d9304af0ca46b9beb5132cbe5c0ce9',uuid=faf3ef57-71fb-4ba2-a817-497c40f649a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Converting VIF {"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=04233350-adb4-44b1-9121-0ec06fd9b577,network=Network(9e63955d-b28f-4b0e-a0de-087239533469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04233350-ad') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG os_vif [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=04233350-adb4-44b1-9121-0ec06fd9b577,network=Network(9e63955d-b28f-4b0e-a0de-087239533469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04233350-ad') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a814b904-016f-5ab7-b9fa-4dcd23dfd8e7', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04233350-ad, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04233350-ad, col_values=(('qos', UUID('5f8a6ed1-564a-4fd3-b509-2cd10f99f4f4')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04233350-ad, col_values=(('external_ids', {'iface-id': '04233350-adb4-44b1-9121-0ec06fd9b577', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:5d:bb', 'vm-uuid': 'faf3ef57-71fb-4ba2-a817-497c40f649a0'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: INFO os_vif [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=04233350-adb4-44b1-9121-0ec06fd9b577,network=Network(9e63955d-b28f-4b0e-a0de-087239533469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04233350-ad')
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] No VIF found with MAC fa:16:3e:4d:5d:bb, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-changed-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Refreshing instance network info cache due to event network-changed-9faebb20-c966-4250-b0f7-947a3a6efacf. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] Acquiring lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updating instance_info_cache with network_info: [{"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Releasing lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Instance network_info: |[{"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] Acquired lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Refreshing network info cache for port 9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Start _get_guest_xml network_info=[{"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:43:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-946530315',display_name='tempest-TestVolumeSwap-server-946530315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-946530315',id=9,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUKbZuZArZ70m9vIJF0+Xwy914Cvu9uHJYv60RFS3YIWGXIYM6dt0rtN2t/5jPirhRhoa8wsLIvNaFKh+jZ1UyEkBSapxbF3yyX4OVkXqEhey9LLZa0lQge6Z+nuEIGvw==',key_name='tempest-keypair-438753428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecaf1abaeeb43efb28629a65c00a7f3',ramdisk_id='',reservation_id='r-q8pfw80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1154616542',owner_user_name='tempest-TestVolumeSwap-1154616542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f58f2ef909547e28317c0986dae386b',uuid=e31123e5-1b35-4456-af70-e6b3c058dae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Converting VIF {"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:a1:be,bridge_name='br-int',has_traffic_filtering=True,id=9faebb20-c966-4250-b0f7-947a3a6efacf,network=Network(fd7c3606-54b1-4f15-a9ef-eff83c363925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faebb20-c9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lazy-loading 'pci_devices' on Instance uuid e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:43:53 user nova-compute[75216]:   <uuid>e31123e5-1b35-4456-af70-e6b3c058dae1</uuid>
Nov 02 04:43:53 user nova-compute[75216]:   <name>instance-00000009</name>
Nov 02 04:43:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:43:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:43:53 user nova-compute[75216]:   <metadata>
Nov 02 04:43:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:43:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:name>tempest-TestVolumeSwap-server-946530315</nova:name>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:43:53</nova:creationTime>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:43:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:43:53 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:owner>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:user uuid="3f58f2ef909547e28317c0986dae386b">tempest-TestVolumeSwap-1154616542-project-member</nova:user>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:project uuid="cecaf1abaeeb43efb28629a65c00a7f3">tempest-TestVolumeSwap-1154616542</nova:project>
Nov 02 04:43:53 user nova-compute[75216]:       </nova:owner>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:43:53 user nova-compute[75216]:       <nova:ports>
Nov 02 04:43:53 user nova-compute[75216]:         <nova:port uuid="9faebb20-c966-4250-b0f7-947a3a6efacf">
Nov 02 04:43:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:43:53 user nova-compute[75216]:         </nova:port>
Nov 02 04:43:53 user nova-compute[75216]:       </nova:ports>
Nov 02 04:43:53 user nova-compute[75216]:     </nova:instance>
Nov 02 04:43:53 user nova-compute[75216]:   </metadata>
Nov 02 04:43:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:43:53 user nova-compute[75216]:     <system>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="serial">e31123e5-1b35-4456-af70-e6b3c058dae1</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="uuid">e31123e5-1b35-4456-af70-e6b3c058dae1</entry>
Nov 02 04:43:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:43:53 user nova-compute[75216]:     </system>
Nov 02 04:43:53 user nova-compute[75216]:   </sysinfo>
Nov 02 04:43:53 user nova-compute[75216]:   <os>
Nov 02 04:43:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:43:53 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:43:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:43:53 user nova-compute[75216]:   </os>
Nov 02 04:43:53 user nova-compute[75216]:   <features>
Nov 02 04:43:53 user nova-compute[75216]:     <acpi/>
Nov 02 04:43:53 user nova-compute[75216]:     <apic/>
Nov 02 04:43:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:43:53 user nova-compute[75216]:   </features>
Nov 02 04:43:53 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:43:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:43:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:43:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:43:53 user nova-compute[75216]:   </clock>
Nov 02 04:43:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:43:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:43:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:43:53 user nova-compute[75216]:   </cpu>
Nov 02 04:43:53 user nova-compute[75216]:   <devices>
Nov 02 04:43:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:43:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:43:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk"/>
Nov 02 04:43:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:43:53 user nova-compute[75216]:     </disk>
Nov 02 04:43:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:43:53 user nova-compute[75216]:       <mac address="fa:16:3e:08:a1:be"/>
Nov 02 04:43:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:43:53 user nova-compute[75216]:       <target dev="tap9faebb20-c9"/>
Nov 02 04:43:53 user nova-compute[75216]:     </interface>
Nov 02 04:43:53 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:43:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/console.log" append="off"/>
Nov 02 04:43:53 user nova-compute[75216]:     </serial>
Nov 02 04:43:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:43:53 user nova-compute[75216]:     <video>
Nov 02 04:43:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:43:53 user nova-compute[75216]:     </video>
Nov 02 04:43:53 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:43:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:43:53 user nova-compute[75216]:     </rng>
Nov 02 04:43:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:43:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:43:53 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:43:53 user nova-compute[75216]:     </memballoon>
Nov 02 04:43:53 user nova-compute[75216]:   </devices>
Nov 02 04:43:53 user nova-compute[75216]: </domain>
Nov 02 04:43:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-946530315',display_name='tempest-TestVolumeSwap-server-946530315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-946530315',id=9,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUKbZuZArZ70m9vIJF0+Xwy914Cvu9uHJYv60RFS3YIWGXIYM6dt0rtN2t/5jPirhRhoa8wsLIvNaFKh+jZ1UyEkBSapxbF3yyX4OVkXqEhey9LLZa0lQge6Z+nuEIGvw==',key_name='tempest-keypair-438753428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecaf1abaeeb43efb28629a65c00a7f3',ramdisk_id='',reservation_id='r-q8pfw80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1154616542',owner_user_name='tempest-TestVolumeSwap-1154616542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f58f2ef909547e28317c0986dae386b',uuid=e31123e5-1b35-4456-af70-e6b3c058dae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Converting VIF {"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:a1:be,bridge_name='br-int',has_traffic_filtering=True,id=9faebb20-c966-4250-b0f7-947a3a6efacf,network=Network(fd7c3606-54b1-4f15-a9ef-eff83c363925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faebb20-c9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG os_vif [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a1:be,bridge_name='br-int',has_traffic_filtering=True,id=9faebb20-c966-4250-b0f7-947a3a6efacf,network=Network(fd7c3606-54b1-4f15-a9ef-eff83c363925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faebb20-c9') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a0ae419-8500-5f8f-a276-69496e261d23', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9faebb20-c9, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9faebb20-c9, col_values=(('qos', UUID('4bc34d4c-acdd-4d7b-b5b2-11df968e2bc5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9faebb20-c9, col_values=(('external_ids', {'iface-id': '9faebb20-c966-4250-b0f7-947a3a6efacf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:a1:be', 'vm-uuid': 'e31123e5-1b35-4456-af70-e6b3c058dae1'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:53 user nova-compute[75216]: INFO os_vif [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a1:be,bridge_name='br-int',has_traffic_filtering=True,id=9faebb20-c966-4250-b0f7-947a3a6efacf,network=Network(fd7c3606-54b1-4f15-a9ef-eff83c363925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faebb20-c9')
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] No VIF found with MAC fa:16:3e:08:a1:be, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updated VIF entry in instance network info cache for port 04233350-adb4-44b1-9121-0ec06fd9b577. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updating instance_info_cache with network_info: [{"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ce893e8-4731-4de4-af6d-7f16b729cfda req-cfe2a74d-049b-4bdc-9329-00910e31798b service nova] Releasing lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updated VIF entry in instance network info cache for port 9faebb20-c966-4250-b0f7-947a3a6efacf. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updating instance_info_cache with network_info: [{"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:43:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8cda9d44-0602-4e0b-b0bc-4628a83be07a req-d9ecf31e-6281-479a-8d9d-0d7408129e3e service nova] Releasing lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:54 user nova-compute[75216]: WARNING nova.compute.manager [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received unexpected event network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd for instance with vm_state active and task_state None.
Nov 02 04:43:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:54 user nova-compute[75216]: WARNING nova.compute.manager [req-35690baa-b88d-473e-9f77-3ec747d31c1d req-2d1d097a-cc99-4fbc-9011-f20d5ab01e0a service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received unexpected event network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd for instance with vm_state active and task_state None.
Nov 02 04:43:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-5818a735-58db-4c7b-9730-0d62a84380a0 req-a0ecc131-408b-4a48-95b0-970939e2c8e3 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5818a735-58db-4c7b-9730-0d62a84380a0 req-a0ecc131-408b-4a48-95b0-970939e2c8e3 service nova] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5818a735-58db-4c7b-9730-0d62a84380a0 req-a0ecc131-408b-4a48-95b0-970939e2c8e3 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5818a735-58db-4c7b-9730-0d62a84380a0 req-a0ecc131-408b-4a48-95b0-970939e2c8e3 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-5818a735-58db-4c7b-9730-0d62a84380a0 req-a0ecc131-408b-4a48-95b0-970939e2c8e3 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] No waiting events found dispatching network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:56 user nova-compute[75216]: WARNING nova.compute.manager [req-5818a735-58db-4c7b-9730-0d62a84380a0 req-a0ecc131-408b-4a48-95b0-970939e2c8e3 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received unexpected event network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 for instance with vm_state building and task_state spawning.
Nov 02 04:43:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] No waiting events found dispatching network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:58 user nova-compute[75216]: WARNING nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received unexpected event network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 for instance with vm_state building and task_state spawning.
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] No waiting events found dispatching network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:58 user nova-compute[75216]: WARNING nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received unexpected event network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf for instance with vm_state building and task_state spawning.
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] No waiting events found dispatching network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:58 user nova-compute[75216]: WARNING nova.compute.manager [req-4f20e60d-3498-43d2-b1b8-49bcb5c12ee5 req-d863ed87-9907-44ad-8750-aaba0efa49d1 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received unexpected event network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf for instance with vm_state building and task_state spawning.
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ad00e65-aa7a-4cdb-a343-8830b889e037 req-dcfaa496-ac39-4353-882b-6d9ca9c0617d service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ad00e65-aa7a-4cdb-a343-8830b889e037 req-dcfaa496-ac39-4353-882b-6d9ca9c0617d service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ad00e65-aa7a-4cdb-a343-8830b889e037 req-dcfaa496-ac39-4353-882b-6d9ca9c0617d service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ad00e65-aa7a-4cdb-a343-8830b889e037 req-dcfaa496-ac39-4353-882b-6d9ca9c0617d service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ad00e65-aa7a-4cdb-a343-8830b889e037 req-dcfaa496-ac39-4353-882b-6d9ca9c0617d service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:43:58 user nova-compute[75216]: WARNING nova.compute.manager [req-3ad00e65-aa7a-4cdb-a343-8830b889e037 req-dcfaa496-ac39-4353-882b-6d9ca9c0617d service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state active and task_state None.
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:43:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Instance spawned successfully.
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Instance spawned successfully.
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:43:59 user nova-compute[75216]: INFO nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Took 9.27 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:43:59 user nova-compute[75216]: INFO nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Took 8.39 seconds to spawn the instance on the hypervisor.
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:43:59 user nova-compute[75216]: INFO nova.compute.manager [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Took 10.25 seconds to build instance.
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66731569-f7cc-42c7-b3c1-044e0610ae5e tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.432s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:59 user nova-compute[75216]: INFO nova.compute.manager [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Took 9.76 seconds to build instance.
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a77ec63-b544-4408-a65e-bb780bd9fda2 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.867s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:43:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc3472ea-e8f2-40df-bece-098950ea3457 req-28ab5a00-c5d0-4fc8-8ae5-cb21aa066cf5 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc3472ea-e8f2-40df-bece-098950ea3457 req-28ab5a00-c5d0-4fc8-8ae5-cb21aa066cf5 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc3472ea-e8f2-40df-bece-098950ea3457 req-28ab5a00-c5d0-4fc8-8ae5-cb21aa066cf5 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc3472ea-e8f2-40df-bece-098950ea3457 req-28ab5a00-c5d0-4fc8-8ae5-cb21aa066cf5 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc3472ea-e8f2-40df-bece-098950ea3457 req-28ab5a00-c5d0-4fc8-8ae5-cb21aa066cf5 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:44:01 user nova-compute[75216]: WARNING nova.compute.manager [req-cc3472ea-e8f2-40df-bece-098950ea3457 req-28ab5a00-c5d0-4fc8-8ae5-cb21aa066cf5 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state active and task_state None.
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:04 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:44:04 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:44:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.447917938232422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:44:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:44:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 277ca9ec-2c10-4312-98f3-9d27b70fc078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 2bf23601-af5f-4d48-a99a-74230fb02935 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 521d9190-7056-42d2-a594-d1ae11b37798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance faf3ef57-71fb-4ba2-a817-497c40f649a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e31123e5-1b35-4456-af70-e6b3c058dae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:44:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.066s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:44:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:44:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:44:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 04:44:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:44:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 277ca9ec-2c10-4312-98f3-9d27b70fc078 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:44:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Updating instance_info_cache with network_info: [{"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-277ca9ec-2c10-4312-98f3-9d27b70fc078" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:44:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:44:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:44:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:44:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:44:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:44:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:44:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:44:47 user nova-compute[75216]: INFO nova.compute.claims [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Claim successful on node user
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:44:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:44:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:44:48 user nova-compute[75216]: INFO nova.virt.block_device [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Booting with volume 212297cc-75e7-4f72-9840-454871258980 at /dev/vda
Nov 02 04:44:48 user nova-compute[75216]: DEBUG nova.policy [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bfecda6e9e74983bbfc99909cd4f53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf82914e81741ce84c804211ad49e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:44:48 user nova-compute[75216]: DEBUG os_brick.utils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:44:48 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwk43jbbg/privsep.sock']
Nov 02 04:44:48 user sudo[86411]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwk43jbbg/privsep.sock
Nov 02 04:44:48 user sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 04:44:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:44:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:44:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:44:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:44:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:44:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully created port: fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully created port: 25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:44:49 user sudo[86411]: pam_unix(sudo:session): session closed for user root
Nov 02 04:44:49 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Spawned new privsep daemon via rootwrap
Nov 02 04:44:49 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 04:44:49 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 04:44:49 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 02 04:44:49 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86414
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9fab6-87d6-47a8-90a5-15795b70b87b]: (2,) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully created port: 401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[858095ae-d79c-4945-8dde-5ac7dd37cd6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.nvmeof [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaff954-8b18-4517-86e0-e2fbd7211fbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe504d25-195b-43fa-ba38-987e1d5c2d9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d5886-24d4-4371-9f31-7e46cc784eae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:44:49 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:44:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec1908-e08b-4cc8-af96-1f628c1d688b]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG os_brick.utils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== get_connector_properties: return (1798ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:44:49 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating existing volume attachment record: db798133-7ebb-4e37-8e37-221e32d58ead {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:44:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully created port: ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:44:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully created port: 3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully updated port: fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-fd720d4c-a08a-4b78-8d45-b88d578d6c42. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cf8c4c01-9649-4063-a2b7-f3d930d8225d req-f33528f0-2a93-4402-9077-d6e9c3f5eb21 service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully updated port: fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully updated port: 3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully updated port: 25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:44:53 user nova-compute[75216]: INFO nova.compute.manager [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] instance snapshotting
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-3c0eac1c-1239-4eb3-b17d-59a8108676e3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port 3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:44:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Beginning live snapshot process
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully updated port: 401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7aee3f5-1a35-4a75-837e-5959cf6ffe77 req-571ff3e7-b635-4bb9-bc74-350ab0c3c3dc service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0xa84ms6/3468df188e0a4ec4aad1d5ab34381b59.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0xa84ms6/3468df188e0a4ec4aad1d5ab34381b59.delta 1073741824" returned: 0 in 0.059s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 04:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75216) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 02 04:44:54 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] UEFI support detected
Nov 02 04:44:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully updated port: ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Successfully updated port: 3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-25a7183c-696f-4591-a10e-c7b247ce24f8. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] COPY block job progress, current cursor: 22085632 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:44:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lazy-loading 'flavor' on Instance uuid 277ca9ec-2c10-4312-98f3-9d27b70fc078 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:44:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0xa84ms6/3468df188e0a4ec4aad1d5ab34381b59.delta /opt/stack/data/nova/instances/snapshots/tmp0xa84ms6/3468df188e0a4ec4aad1d5ab34381b59 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:44:57 user nova-compute[75216]: INFO nova.compute.manager [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Attaching volume d51e650b-3724-4ed1-9b45-1a242ed0e05b to /dev/vdb
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG os_brick.utils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d93ba79-1890-455c-a216-450687ee06b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c9d7a4-aa8c-4cb2-b2c4-2dbc6c90b46b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ed587-9c50-4c92-8c3d-c5b86e1a1855]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff2d37-512d-45e2-b6d9-23e8405f7258]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:44:57 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff9de28-983a-4a2a-98b2-90bee229a7cc]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG os_brick.utils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Updating existing volume attachment record: 4462a3e3-0c35-4a2d-b4c5-a85ee9a02f69 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0xa84ms6/3468df188e0a4ec4aad1d5ab34381b59.delta /opt/stack/data/nova/instances/snapshots/tmp0xa84ms6/3468df188e0a4ec4aad1d5ab34381b59" returned: 0 in 0.535s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:44:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Snapshot extracted, beginning image upload
Nov 02 04:44:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance network_info: |[{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port 25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updated VIF entry in instance network info cache for port 25a7183c-696f-4591-a10e-c7b247ce24f8. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-401a8b69-4f19-4848-8643-e69bce5bf926. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port 401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updated VIF entry in instance network info cache for port 401a8b69-4f19-4848-8643-e69bce5bf926. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-ad9448fb-8767-4ee1-8f84-d004f78ce062. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updated VIF entry in instance network info cache for port ad9448fb-8767-4ee1-8f84-d004f78ce062. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25c348f7-e2de-4add-9d65-73bcdddb6405 req-62767869-021d-4abf-a67e-d901becb5a63 service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port 3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updated VIF entry in instance network info cache for port 3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae618377-ad2b-473a-845c-12657b676c28 req-c4683637-7eac-488e-ac20-5a7e6c47f527 service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:45:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Snapshot image upload complete
Nov 02 04:45:00 user nova-compute[75216]: INFO nova.compute.manager [None req-bb82abda-c634-4f41-8743-d107408e4387 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Took 6.61 seconds to snapshot the instance on the hypervisor.
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-changed-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Refreshing instance network info cache due to event network-changed-a7dabe6f-d443-44a3-9e79-445efa48e57e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] Acquiring lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] Acquired lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Refreshing network info cache for port a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-changed-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Refreshing instance network info cache due to event network-changed-80407938-aa15-40c0-b5a0-2100f2d9b864. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] Acquiring lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] Acquired lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Refreshing network info cache for port 80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-changed-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Refreshing instance network info cache due to event network-changed-71df5a7f-f774-428f-8f64-138cb2f78152. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] Acquiring lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] Acquired lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Refreshing network info cache for port 71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updated VIF entry in instance network info cache for port a7dabe6f-d443-44a3-9e79-445efa48e57e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updating instance_info_cache with network_info: [{"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0164c7d6-10a0-41f5-bbf2-5da03501541b req-575fcd32-3716-4f1e-971a-3d763033d618 service nova] Releasing lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updated VIF entry in instance network info cache for port 80407938-aa15-40c0-b5a0-2100f2d9b864. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e164819c-2f5e-49f8-b56e-f8ead54e3769 req-4cb3f0ab-32f5-4f21-ab58-2402441e74eb service nova] Releasing lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updated VIF entry in instance network info cache for port 71df5a7f-f774-428f-8f64-138cb2f78152. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updating instance_info_cache with network_info: [{"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-67d3a61c-2940-4f99-a5c3-33108438e5a7 req-a2619424-e36d-4a3b-9e16-072ef8dc7b54 service nova] Releasing lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:45:04 user nova-compute[75216]: INFO nova.compute.manager [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] instance snapshotting
Nov 02 04:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Beginning live snapshot process
Nov 02 04:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:45:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7281MB free_disk=25.274436950683594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 277ca9ec-2c10-4312-98f3-9d27b70fc078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 2bf23601-af5f-4d48-a99a-74230fb02935 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 521d9190-7056-42d2-a594-d1ae11b37798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance faf3ef57-71fb-4ba2-a817-497c40f649a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e31123e5-1b35-4456-af70-e6b3c058dae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 075b3db8-71aa-4bd7-8c7a-8cc5835594de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb2rf3l2o/0b9c594e9d8e43c497dffccc5f770776.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb2rf3l2o/0b9c594e9d8e43c497dffccc5f770776.delta 1073741824" returned: 0 in 0.057s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 04:45:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:45:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 04:45:07 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:45:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb2rf3l2o/0b9c594e9d8e43c497dffccc5f770776.delta /opt/stack/data/nova/instances/snapshots/tmpb2rf3l2o/0b9c594e9d8e43c497dffccc5f770776 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb2rf3l2o/0b9c594e9d8e43c497dffccc5f770776.delta /opt/stack/data/nova/instances/snapshots/tmpb2rf3l2o/0b9c594e9d8e43c497dffccc5f770776" returned: 0 in 0.405s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Snapshot extracted, beginning image upload
Nov 02 04:45:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG nova.objects.instance [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid a2b40b8c-5b97-4bf8-adad-647ff27e2bab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:09 user nova-compute[75216]: INFO nova.compute.manager [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Attaching volume 971421e3-d718-4518-ab97-0650b558c700 to /dev/vdb
Nov 02 04:45:09 user nova-compute[75216]: DEBUG os_brick.utils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1651d7-d1e8-4d4c-a699-9225f7736f3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b547aa6-ebcf-4ec7-93ad-b4c204d886d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2772d9e0-46aa-4af5-87bf-cf51285d47d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8821f69-178c-4202-a659-7af5432aa390]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:09 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e337da-d5f6-49f1-9864-27423fc2abdd]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG os_brick.utils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updating existing volume attachment record: 9e3798bd-643f-44db-a5e4-15bf592a6c3e {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updating instance_info_cache with network_info: [{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:45:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Snapshot image upload complete
Nov 02 04:45:10 user nova-compute[75216]: INFO nova.compute.manager [None req-2fd6e44e-14af-4587-b168-83d9ee054bb1 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Took 6.18 seconds to snapshot the instance on the hypervisor.
Nov 02 04:45:11 user nova-compute[75216]: INFO nova.virt.block_device [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Booting with volume 3211f4e2-6987-4b49-a1f7-04d87be936ed at /dev/vdb
Nov 02 04:45:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7499a7b7-5cb1-45f2-a111-14ce18f331e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6360369-2132-4e85-98c7-06f1f359fca2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f8f1fe-b84f-4f2b-866b-74105cfd09b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fc6f94-9f88-4ee2-a98c-a335dd0e27b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:12 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:45:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdafa4-9540-421d-903e-b07c0e781c1e]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG os_brick.utils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:12 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating existing volume attachment record: 9c768fe2-79f4-43d3-9ac3-f0ca4deadbc6 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:45:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-changed-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Refreshing instance network info cache due to event network-changed-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] Acquiring lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] Acquired lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Refreshing network info cache for port 8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connector [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Factory for ISCSI on None {{(pid=75216) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szgyAuhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:18 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:18 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:18 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:45:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7371bf-09a3-4efc-b320-46632123a67b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:45:18 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95e9a07-b50a-409a-a3ed-5da672100561]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b] added
Nov 02 04:45:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9e300-1fe9-4ee0-8d38-0f432ef9f68e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e0ac55-8f7d-4ba8-b293-3a48983ba9b1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szgyAuhO {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szgyAuhO" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d3688d-c76d-4fa3-bc35-b6c1bc7ff886]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'szgyAuhO'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45017293-8f2c-49b2-876f-f5a1067adc8f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed146d2-6abf-4695-9364-f6342360c5ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 04:45:18 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 04:45:18 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:18 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 04:45:18 user nova-compute[75216]: 
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbaa9a6-3fa5-4101-9db8-bd3ef4b6d759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260]
Nov 02 04:45:18 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260] successful.
Nov 02 04:45:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e77e418-25ca-4716-9e02-d5431ffc61f6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db2f95-2e62-45f1-8ac2-8626952277fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bf076-1574-42a6-93eb-8ff5b8f9e700]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:45:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szgyAuhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Updated VIF entry in instance network info cache for port 8f26575a-4e2a-4198-98a9-7fc67e5cfe0f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Updating instance_info_cache with network_info: [{"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05ff37b6-f9f3-4960-8be3-fe09d5ec4ca8 req-d84ed1e8-5dcf-4005-a767-c22865b22df6 service nova] Releasing lock "refresh_cache-2bf23601-af5f-4d48-a99a-74230fb02935" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:19 user nova-compute[75216]: INFO nova.compute.manager [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Attaching volume 190e3f9b-861b-4d12-a12f-e6c99f3fca12 to /dev/vdb
Nov 02 04:45:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45013121-a770-4676-8408-916683548ad7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab6b26a-0ec2-4c68-95c1-417fbdeb9c77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677c933-2148-4632-9cf3-fc3bfdb9baad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faceabb-9e18-4039-96aa-38aa077a3f48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:19 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:45:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b0da7-f176-476a-8c2f-964c63ff8ea0]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:19 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating existing volume attachment record: bf699209-2261-4561-b7ba-49717a5e8af8 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26266366237656630', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266366237656630', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lazy-loading 'flavor' on Instance uuid 277ca9ec-2c10-4312-98f3-9d27b70fc078 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:45:20 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:45:20 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:45:20 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:45:20 user nova-compute[75216]:   <serial>d51e650b-3724-4ed1-9b45-1a242ed0e05b</serial>
Nov 02 04:45:20 user nova-compute[75216]: </disk>
Nov 02 04:45:20 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] No VIF found with MAC fa:16:3e:2f:bd:ff, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-changed-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Refreshing instance network info cache due to event network-changed-9df687c6-2d85-4a7f-9afc-be274cd71afd. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] Acquiring lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] Acquired lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:29 user nova-compute[75216]: DEBUG nova.network.neutron [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Refreshing network info cache for port 9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "interface-521d9190-7056-42d2-a594-d1ae11b37798-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "interface-521d9190-7056-42d2-a594-d1ae11b37798-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'flavor' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updated VIF entry in instance network info cache for port 9df687c6-2d85-4a7f-9afc-be274cd71afd. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cb9bd2ef-79df-48e2-861d-3682a87679dc req-9c3f899d-211e-4ef9-87fa-3bf26b10da93 service nova] Releasing lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'pci_requests' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.objects.base [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Object Instance<521d9190-7056-42d2-a594-d1ae11b37798> lazy-loaded attributes: flavor,pci_requests {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.policy [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0544ce72c149454ebea470afdebf777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db9bb5dbed54b22b9144e4fc46e2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bzTkDOji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:30 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:30 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:30 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80191599-2b6f-431a-8875-9355b103d6b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:45:30 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8230fe4-bcb9-477b-af9b-df3afe943c15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700] added
Nov 02 04:45:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de8178-5035-41cf-ab81-036c7dea81e6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab536788-3c38-4d3d-b812-e6c4a4c69f24]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bzTkDOji {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bzTkDOji" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9128ff-88c3-41d6-b4d6-2a778cf5e4e0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bzTkDOji'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36e338-7eb0-43e4-866f-5a01f9cbe450]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b34b8acd-e43a-41e0-804e-bb56331d2899 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.628s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f919c9-eba0-4699-a53f-6d0ac11bf144]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae0a5f-d808-4af7-b439-31bc0a9b3ece]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260]
Nov 02 04:45:31 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260] successful.
Nov 02 04:45:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f2a47f-289e-41f2-a906-46b17f2127f4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba037c1e-93c0-4f66-806a-6c2774be7f9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:31 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:31 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33df41-5872-4925-b528-27513d2d9aae]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bzTkDOji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG nova.objects.instance [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lazy-loading 'flavor' on Instance uuid 2bf23601-af5f-4d48-a99a-74230fb02935 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Successfully created port: c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:31 user nova-compute[75216]: INFO nova.compute.manager [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Terminating instance
Nov 02 04:45:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:31 user nova-compute[75216]: INFO nova.compute.manager [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Attaching volume ab19b245-b00b-40ce-a30b-fc7a68442e57 to /dev/sdc
Nov 02 04:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.utils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0063c616-8696-4897-9bd5-e538d02fa272]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be156494-dba0-42da-92f4-4d96d9a916f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46b2c8-f809-489c-bf9c-a27f835d4d6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a0518-2c91-4e38-87ed-960e1d14df7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:31 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[344bb6a6-6388-4b94-a642-e92f7eadd2c6]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG os_brick.utils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Updating existing volume attachment record: 7ef268f0-0382-4cf1-a90a-08d4062f2499 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-47c4ed03-f37b-484c-a108-442db76a820c req-d9d7d18b-ae70-4340-b634-cc9c34972d51 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received event network-vif-unplugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47c4ed03-f37b-484c-a108-442db76a820c req-d9d7d18b-ae70-4340-b634-cc9c34972d51 service nova] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47c4ed03-f37b-484c-a108-442db76a820c req-d9d7d18b-ae70-4340-b634-cc9c34972d51 service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47c4ed03-f37b-484c-a108-442db76a820c req-d9d7d18b-ae70-4340-b634-cc9c34972d51 service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-47c4ed03-f37b-484c-a108-442db76a820c req-d9d7d18b-ae70-4340-b634-cc9c34972d51 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] No waiting events found dispatching network-vif-unplugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-47c4ed03-f37b-484c-a108-442db76a820c req-d9d7d18b-ae70-4340-b634-cc9c34972d51 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received event network-vif-unplugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Successfully updated port: c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquired lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-changed-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Refreshing instance network info cache due to event network-changed-c46e7044-1d57-4413-890f-5099026b4aa5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] Acquiring lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23330313863616236', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330313863616236', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid a2b40b8c-5b97-4bf8-adad-647ff27e2bab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:45:32 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:45:32 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:45:32 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:45:32 user nova-compute[75216]:   <serial>971421e3-d718-4518-ab97-0650b558c700</serial>
Nov 02 04:45:32 user nova-compute[75216]: </disk>
Nov 02 04:45:32 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:45:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Instance destroyed successfully.
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lazy-loading 'resources' on Instance uuid 277ca9ec-2c10-4312-98f3-9d27b70fc078 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1048258121',display_name='tempest-DeleteServersTestJSON-server-1048258121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1048258121',id=1,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f30a37a0127643bf855abd107709f46c',ramdisk_id='',reservation_id='r-lipr52dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-67129306',owner_user_name='tempest-DeleteServersTestJSON-67129306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:16Z,user_data=None,user_id='99e34f43747842bf940dd4962cccc8b0',uuid=277ca9ec-2c10-4312-98f3-9d27b70fc078,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Converting VIF {"id": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "address": "fa:16:3e:2f:bd:ff", "network": {"id": "c95ad790-b882-4126-889f-4996824dd81b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-669782692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30a37a0127643bf855abd107709f46c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b72af68-a0", "ovs_interfaceid": "6b72af68-a0e3-4de8-9d0e-3b6189a0738c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bd:ff,bridge_name='br-int',has_traffic_filtering=True,id=6b72af68-a0e3-4de8-9d0e-3b6189a0738c,network=Network(c95ad790-b882-4126-889f-4996824dd81b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b72af68-a0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_vif [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bd:ff,bridge_name='br-int',has_traffic_filtering=True,id=6b72af68-a0e3-4de8-9d0e-3b6189a0738c,network=Network(c95ad790-b882-4126-889f-4996824dd81b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b72af68-a0') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b72af68-a0, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5209e264-f823-4f6e-9e74-cf7cd6fb39c4) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:32 user nova-compute[75216]: INFO os_vif [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bd:ff,bridge_name='br-int',has_traffic_filtering=True,id=6b72af68-a0e3-4de8-9d0e-3b6189a0738c,network=Network(c95ad790-b882-4126-889f-4996824dd81b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b72af68-a0')
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szgyAuhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:32 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No VIF found with MAC fa:16:3e:b7:95:58, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d4bf61-3a5b-4610-b976-63f7d5bfafec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:45:32 user nova-compute[75216]: No targets found.
Nov 02 04:45:32 user nova-compute[75216]: iSNS:
Nov 02 04:45:32 user nova-compute[75216]: No targets found.
Nov 02 04:45:32 user nova-compute[75216]: STATIC:
Nov 02 04:45:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:45:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:45:32 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:45:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b
Nov 02 04:45:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:45:32 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:45:32 user nova-compute[75216]: FIRMWARE:
Nov 02 04:45:32 user nova-compute[75216]: No targets found.
Nov 02 04:45:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:45:32 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:45:32 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe03a5-b98c-4f0e-8f56-99be7e9acb8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f4dea0-51b3-4f16-afc9-e63e3c308606]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:32 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b (non-flash)
Nov 02 04:45:32 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460c0ab400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab871b8d-448e-42c9-ba7a-a816cba10e30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ee79d2-00ea-422b-a44a-ce7778955538]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d14e18-e389-40d7-919a-ce9e0e7934b5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc7b46e-0ca8-442b-a4f0-3faf2a3b7146]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Releasing lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] Acquired lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Refreshing network info cache for port c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converting VIF {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_vif [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71d403fe-1e46-5f7c-a574-182c81b2f635', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e11cae-4877-4001-a9a8-9859c9f7b215]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc46e7044-1d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc46e7044-1d, col_values=(('qos', UUID('9d107ebd-82ce-4931-80bb-f80176d39583')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc46e7044-1d, col_values=(('external_ids', {'iface-id': 'c46e7044-1d57-4413-890f-5099026b4aa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:57:07', 'vm-uuid': '521d9190-7056-42d2-a594-d1ae11b37798'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: INFO os_vif [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d')
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converting VIF {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] attach device xml: <interface type="ethernet">
Nov 02 04:45:33 user nova-compute[75216]:   <mac address="fa:16:3e:f0:57:07"/>
Nov 02 04:45:33 user nova-compute[75216]:   <model type="virtio"/>
Nov 02 04:45:33 user nova-compute[75216]:   <mtu size="1442"/>
Nov 02 04:45:33 user nova-compute[75216]:   <target dev="tapc46e7044-1d"/>
Nov 02 04:45:33 user nova-compute[75216]: </interface>
Nov 02 04:45:33 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8f1018-7c40-4cd2-82d9-dd5d74fd188c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260]
Nov 02 04:45:33 user nova-compute[75216]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b, portal: 172.16.0.220,3260] successful.
Nov 02 04:45:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51e650b-3724-4ed1-9b45-1a242ed0e05b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d005e7-6554-4bf3-9515-1363519c3069]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] <== disconnect_volume: return (338ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:45:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Deleting instance files /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078_del
Nov 02 04:45:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Deletion of /opt/stack/data/nova/instances/277ca9ec-2c10-4312-98f3-9d27b70fc078_del complete
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: INFO nova.compute.manager [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Took 1.66 seconds to destroy the instance on the hypervisor.
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No VIF found with MAC fa:16:3e:a1:68:27, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:45:33 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 02 04:45:33 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:45:33 user nova-compute[75216]:   <nova:creationTime>2023-11-02 04:45:33</nova:creationTime>
Nov 02 04:45:33 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 02 04:45:33 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 02 04:45:33 user nova-compute[75216]:   </nova:flavor>
Nov 02 04:45:33 user nova-compute[75216]:   <nova:owner>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:45:33 user nova-compute[75216]:   </nova:owner>
Nov 02 04:45:33 user nova-compute[75216]:   <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:45:33 user nova-compute[75216]:   <nova:ports>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:45:33 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:45:33 user nova-compute[75216]:     </nova:port>
Nov 02 04:45:33 user nova-compute[75216]:     <nova:port uuid="c46e7044-1d57-4413-890f-5099026b4aa5">
Nov 02 04:45:33 user nova-compute[75216]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Nov 02 04:45:33 user nova-compute[75216]:     </nova:port>
Nov 02 04:45:33 user nova-compute[75216]:   </nova:ports>
Nov 02 04:45:33 user nova-compute[75216]: </nova:instance>
Nov 02 04:45:33 user nova-compute[75216]:  {{(pid=75216) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efa597c9-5f60-4995-901f-6ccc407b8dda tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "interface-521d9190-7056-42d2-a594-d1ae11b37798-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.620s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updated VIF entry in instance network info cache for port c46e7044-1d57-4413-890f-5099026b4aa5. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6fdf6049-6105-45fd-a931-e01edc2511c7 req-1eafe5bd-75af-4149-b5be-2f5137d8df4f service nova] Releasing lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9151657-2add-4efa-b9e9-e5c65221f14b req-f46d3257-65da-457d-9a12-f8fd7ced7e66 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received event network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9151657-2add-4efa-b9e9-e5c65221f14b req-f46d3257-65da-457d-9a12-f8fd7ced7e66 service nova] Acquiring lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9151657-2add-4efa-b9e9-e5c65221f14b req-f46d3257-65da-457d-9a12-f8fd7ced7e66 service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9151657-2add-4efa-b9e9-e5c65221f14b req-f46d3257-65da-457d-9a12-f8fd7ced7e66 service nova] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9151657-2add-4efa-b9e9-e5c65221f14b req-f46d3257-65da-457d-9a12-f8fd7ced7e66 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] No waiting events found dispatching network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:33 user nova-compute[75216]: WARNING nova.compute.manager [req-a9151657-2add-4efa-b9e9-e5c65221f14b req-f46d3257-65da-457d-9a12-f8fd7ced7e66 service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received unexpected event network-vif-plugged-6b72af68-a0e3-4de8-9d0e-3b6189a0738c for instance with vm_state active and task_state deleting.
Nov 02 04:45:34 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:34 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Took 0.88 seconds to deallocate network for instance.
Nov 02 04:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:34 user nova-compute[75216]: WARNING nova.compute.manager [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received unexpected event network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 for instance with vm_state active and task_state None.
Nov 02 04:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:34 user nova-compute[75216]: WARNING nova.compute.manager [req-c359525f-8509-4f4c-8e51-3e65280f1eb7 req-f435829b-0985-4665-acb7-710d264a3bdc service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received unexpected event network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 for instance with vm_state active and task_state None.
Nov 02 04:45:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-1fa7b3b2-7e7f-46e6-9cd7-90c4235a9565 req-34472201-dca7-4914-a6a0-94e3c021c10d service nova] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Received event network-vif-deleted-6b72af68-a0e3-4de8-9d0e-3b6189a0738c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-changed-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Refreshing instance network info cache due to event network-changed-04233350-adb4-44b1-9121-0ec06fd9b577. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] Acquiring lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] Acquired lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Refreshing network info cache for port 04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updated VIF entry in instance network info cache for port 04233350-adb4-44b1-9121-0ec06fd9b577. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updating instance_info_cache with network_info: [{"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5bd891c-6f19-43fd-bc9e-a9d0aab9deb6 req-1288cd89-e53e-4687-bb0f-e8479c868e08 service nova] Releasing lock "refresh_cache-faf3ef57-71fb-4ba2-a817-497c40f649a0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-changed-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Refreshing instance network info cache due to event network-changed-9faebb20-c966-4250-b0f7-947a3a6efacf. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] Acquiring lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] Acquired lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Refreshing network info cache for port 9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updated VIF entry in instance network info cache for port 9faebb20-c966-4250-b0f7-947a3a6efacf. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updating instance_info_cache with network_info: [{"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-038e04f3-60af-4974-a979-6a93b1fce987 req-c42f7bfa-a391-49f7-8ebb-c460c32a47db service nova] Releasing lock "refresh_cache-e31123e5-1b35-4456-af70-e6b3c058dae1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JztYWQgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:41 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:41 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:41 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f88e39-c004-4be1-8b24-4b91d60ff563]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:45:41 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f4b46a-77a9-495b-a046-f04b10cd4314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12] added
Nov 02 04:45:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3ab992-edf1-45a6-a4e8-fe982c6d47ed]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e9c234-a6df-4a7c-85e9-4085c1fa5c93]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JztYWQgk {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JztYWQgk" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e84d21-ac2e-4a2e-9b45-fd039d65fdb4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JztYWQgk'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.077s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd8c2e-04df-4ead-b33c-886ac32d0832]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[89465adc-0e66-46a4-9164-82576854f7f0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[86497dc0-b6d9-4318-a5c6-c4746ba5ab64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]
Nov 02 04:45:41 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.
Nov 02 04:45:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e45ebc-7de7-4026-910b-a04af15008a4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-612d43b7-46f2-421d-ae57-dfd6a9841c6a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.829s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dae92ae-8acb-44a8-8bc0-7859d22f2157]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:41 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:45:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:41 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:45:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5410cd-9fe1-4a4b-a3b0-cbc61558140b]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'flavor' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:42 user nova-compute[75216]: INFO nova.compute.manager [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] [instance: 277ca9ec-2c10-4312-98f3-9d27b70fc078] Took 8.80 seconds to detach 1 volumes for instance.
Nov 02 04:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JztYWQgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26136633765396164', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136633765396164', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:45:42 user nova-compute[75216]: DEBUG nova.objects.instance [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:45:43 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:45:43 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:45:43 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:45:43 user nova-compute[75216]:   <serial>190e3f9b-861b-4d12-a12f-e6c99f3fca12</serial>
Nov 02 04:45:43 user nova-compute[75216]: </disk>
Nov 02 04:45:43 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lazy-loading 'flavor' on Instance uuid faf3ef57-71fb-4ba2-a817-497c40f649a0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lazy-loading 'flavor' on Instance uuid e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:43 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Deleted allocations for instance 277ca9ec-2c10-4312-98f3-9d27b70fc078
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No VIF found with MAC fa:16:3e:ba:61:ab, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:43 user nova-compute[75216]: INFO nova.compute.manager [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Attaching volume 87df26d5-dd3e-428c-8483-d0deb774e017 to /dev/vdb
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5fd60cc8-4f62-4398-b9d9-ae67ceec5679 tempest-DeleteServersTestJSON-67129306 tempest-DeleteServersTestJSON-67129306-project-member] Lock "277ca9ec-2c10-4312-98f3-9d27b70fc078" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.005s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:43 user nova-compute[75216]: INFO nova.compute.manager [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Attaching volume ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 to /dev/vdb
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:43 user nova-compute[75216]: INFO nova.compute.manager [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Attaching volume 7e2e1e7a-db6e-4165-9e67-b54579d54813 to /dev/vdb
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21a2f934-2304-46f4-a1bc-52541ba7a7aa tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.472s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c18780e-4d52-417c-b95c-38da1ef58f97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f82e849-8b5d-41c2-bddb-77b51cffdb1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe40902-bc01-45ab-a184-de4f62956a4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e4039d-3f08-4cc3-aa18-8d1489d1c5cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:44 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec424811-96c0-4d6d-a990-dd58a7b89fa1]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating existing volume attachment record: e50abaea-e561-4929-adb5-96c3f64134fa {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b987f671-e766-496c-a83f-f13bf9c72f11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0679a-2275-4094-bb80-0aa707902c96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0139f0-121c-4cb4-8cd9-27097b0c1d77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb89cf27-a6ad-42c0-bcc3-46df1dc16792]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cf8d7-ec78-42b0-bb42-db646adef6dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78ad1fb-2550-4051-b02b-f46c646a2106]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9eda8a-a5d0-47c1-ad1e-aaf7e873f37d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:44 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f5f20-aa92-42ec-ade4-a8d1415c293b]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d147fd0-7338-41a7-b078-c9d1fe03f4cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updating existing volume attachment record: 6565f02a-4695-4a59-8df9-7b1e57fdc084 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:45:44 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[baee8597-db01-464b-be6e-fd2f60cc6c55]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:44 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updating existing volume attachment record: d8e88a24-97ba-4655-a2b1-8b217194a47a {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:45:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:45:46 user nova-compute[75216]: INFO nova.compute.claims [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Claim successful on node user
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb9d2587-5a16-4611-aae6-0025e719e4fe tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb9d2587-5a16-4611-aae6-0025e719e4fe tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fb9d2587-5a16-4611-aae6-0025e719e4fe tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fb9d2587-5a16-4611-aae6-0025e719e4fe tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75216) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fb9d2587-5a16-4611-aae6-0025e719e4fe tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:45:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG nova.policy [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43528060361f4924b8a858bdd2e731cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01690c91146afa3833bea67f8157f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:45:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Creating image(s)
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "/opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9a5d2d9-7a15-401d-a367-4bac3ee7024b req-3512c524-2cdf-4d48-912e-46675fe99343 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9a5d2d9-7a15-401d-a367-4bac3ee7024b req-3512c524-2cdf-4d48-912e-46675fe99343 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9a5d2d9-7a15-401d-a367-4bac3ee7024b req-3512c524-2cdf-4d48-912e-46675fe99343 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9a5d2d9-7a15-401d-a367-4bac3ee7024b req-3512c524-2cdf-4d48-912e-46675fe99343 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9a5d2d9-7a15-401d-a367-4bac3ee7024b req-3512c524-2cdf-4d48-912e-46675fe99343 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:47 user nova-compute[75216]: WARNING nova.compute.manager [req-a9a5d2d9-7a15-401d-a367-4bac3ee7024b req-3512c524-2cdf-4d48-912e-46675fe99343 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state active and task_state powering-off.
Nov 02 04:45:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.608s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance destroyed successfully.
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fb9d2587-5a16-4611-aae6-0025e719e4fe tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Successfully created port: a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk 1073741824" returned: 0 in 0.067s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.678s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb9d2587-5a16-4611-aae6-0025e719e4fe tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.138s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Cannot resize image /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Ensure instance console log exists: /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Successfully updated port: a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquired lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Updating instance_info_cache with network_info: [{"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Releasing lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Instance network_info: |[{"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Start _get_guest_xml network_info=[{"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:45:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:45:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1001261671',display_name='tempest-AttachVolumeNegativeTest-server-1001261671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1001261671',id=11,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAExkbWmle+Lth24tTiSJIgwv+fbE/VHI4MeG3Osg0jtsEdEWJPrU4IrHR/XwXIzniUy3zcV5QGZB9JveKIeiWzg475ApBKxtDvAWrATX14+CYNcmc+/Fw5YmvsqrrsuRg==',key_name='tempest-keypair-963166459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-fpzw9269',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=1790f117-7ae5-4b92-8c68-13d8da9f18ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:c4,bridge_name='br-int',has_traffic_filtering=True,id=a99d1c1b-fbac-4040-9a24-552930e830a5,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99d1c1b-fb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'pci_devices' on Instance uuid 1790f117-7ae5-4b92-8c68-13d8da9f18ff {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:45:49 user nova-compute[75216]:   <uuid>1790f117-7ae5-4b92-8c68-13d8da9f18ff</uuid>
Nov 02 04:45:49 user nova-compute[75216]:   <name>instance-0000000b</name>
Nov 02 04:45:49 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:45:49 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:45:49 user nova-compute[75216]:   <metadata>
Nov 02 04:45:49 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:45:49 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:45:49 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1001261671</nova:name>
Nov 02 04:45:49 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:45:49</nova:creationTime>
Nov 02 04:45:49 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:45:49 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:45:49 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:45:49 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:45:49 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:45:49 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:45:49 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:45:49 user nova-compute[75216]:       <nova:owner>
Nov 02 04:45:49 user nova-compute[75216]:         <nova:user uuid="43528060361f4924b8a858bdd2e731cc">tempest-AttachVolumeNegativeTest-1766043636-project-member</nova:user>
Nov 02 04:45:49 user nova-compute[75216]:         <nova:project uuid="e1c01690c91146afa3833bea67f8157f">tempest-AttachVolumeNegativeTest-1766043636</nova:project>
Nov 02 04:45:49 user nova-compute[75216]:       </nova:owner>
Nov 02 04:45:49 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:45:49 user nova-compute[75216]:       <nova:ports>
Nov 02 04:45:49 user nova-compute[75216]:         <nova:port uuid="a99d1c1b-fbac-4040-9a24-552930e830a5">
Nov 02 04:45:49 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 04:45:49 user nova-compute[75216]:         </nova:port>
Nov 02 04:45:49 user nova-compute[75216]:       </nova:ports>
Nov 02 04:45:49 user nova-compute[75216]:     </nova:instance>
Nov 02 04:45:49 user nova-compute[75216]:   </metadata>
Nov 02 04:45:49 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:45:49 user nova-compute[75216]:     <system>
Nov 02 04:45:49 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:45:49 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:45:49 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:45:49 user nova-compute[75216]:       <entry name="serial">1790f117-7ae5-4b92-8c68-13d8da9f18ff</entry>
Nov 02 04:45:49 user nova-compute[75216]:       <entry name="uuid">1790f117-7ae5-4b92-8c68-13d8da9f18ff</entry>
Nov 02 04:45:49 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:45:49 user nova-compute[75216]:     </system>
Nov 02 04:45:49 user nova-compute[75216]:   </sysinfo>
Nov 02 04:45:49 user nova-compute[75216]:   <os>
Nov 02 04:45:49 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:45:49 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:45:49 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:45:49 user nova-compute[75216]:   </os>
Nov 02 04:45:49 user nova-compute[75216]:   <features>
Nov 02 04:45:49 user nova-compute[75216]:     <acpi/>
Nov 02 04:45:49 user nova-compute[75216]:     <apic/>
Nov 02 04:45:49 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:45:49 user nova-compute[75216]:   </features>
Nov 02 04:45:49 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:45:49 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:45:49 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:45:49 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:45:49 user nova-compute[75216]:   </clock>
Nov 02 04:45:49 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:45:49 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:45:49 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:45:49 user nova-compute[75216]:   </cpu>
Nov 02 04:45:49 user nova-compute[75216]:   <devices>
Nov 02 04:45:49 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:45:49 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:45:49 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk"/>
Nov 02 04:45:49 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:45:49 user nova-compute[75216]:     </disk>
Nov 02 04:45:49 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:45:49 user nova-compute[75216]:       <mac address="fa:16:3e:bd:91:c4"/>
Nov 02 04:45:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:45:49 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:45:49 user nova-compute[75216]:       <target dev="tapa99d1c1b-fb"/>
Nov 02 04:45:49 user nova-compute[75216]:     </interface>
Nov 02 04:45:49 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:45:49 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/console.log" append="off"/>
Nov 02 04:45:49 user nova-compute[75216]:     </serial>
Nov 02 04:45:49 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:45:49 user nova-compute[75216]:     <video>
Nov 02 04:45:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:45:49 user nova-compute[75216]:     </video>
Nov 02 04:45:49 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:45:49 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:45:49 user nova-compute[75216]:     </rng>
Nov 02 04:45:49 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:45:49 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:45:49 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:45:49 user nova-compute[75216]:     </memballoon>
Nov 02 04:45:49 user nova-compute[75216]:   </devices>
Nov 02 04:45:49 user nova-compute[75216]: </domain>
Nov 02 04:45:49 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1001261671',display_name='tempest-AttachVolumeNegativeTest-server-1001261671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1001261671',id=11,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAExkbWmle+Lth24tTiSJIgwv+fbE/VHI4MeG3Osg0jtsEdEWJPrU4IrHR/XwXIzniUy3zcV5QGZB9JveKIeiWzg475ApBKxtDvAWrATX14+CYNcmc+/Fw5YmvsqrrsuRg==',key_name='tempest-keypair-963166459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-fpzw9269',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=1790f117-7ae5-4b92-8c68-13d8da9f18ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:c4,bridge_name='br-int',has_traffic_filtering=True,id=a99d1c1b-fbac-4040-9a24-552930e830a5,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99d1c1b-fb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG os_vif [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:c4,bridge_name='br-int',has_traffic_filtering=True,id=a99d1c1b-fbac-4040-9a24-552930e830a5,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99d1c1b-fb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd28efc55-1f3f-5269-b56b-59a56e0ee117', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa99d1c1b-fb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa99d1c1b-fb, col_values=(('qos', UUID('b9d1dd61-50bd-490c-9efc-dbf479bf7a75')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa99d1c1b-fb, col_values=(('external_ids', {'iface-id': 'a99d1c1b-fbac-4040-9a24-552930e830a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:91:c4', 'vm-uuid': '1790f117-7ae5-4b92-8c68-13d8da9f18ff'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:49 user nova-compute[75216]: INFO os_vif [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:c4,bridge_name='br-int',has_traffic_filtering=True,id=a99d1c1b-fbac-4040-9a24-552930e830a5,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99d1c1b-fb')
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No VIF found with MAC fa:16:3e:bd:91:c4, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:49 user nova-compute[75216]: WARNING nova.compute.manager [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state stopped and task_state None.
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-changed-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Refreshing instance network info cache due to event network-changed-a99d1c1b-fbac-4040-9a24-552930e830a5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] Acquiring lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] Acquired lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Refreshing network info cache for port a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Updated VIF entry in instance network info cache for port a99d1c1b-fbac-4040-9a24-552930e830a5. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Updating instance_info_cache with network_info: [{"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85c5c057-8f30-4b2b-9d54-1e740e3cd67f req-c3cefccf-b3f3-4167-b3ed-28473743d8f6 service nova] Releasing lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0861c78-c249-4227-8253-6c23a25acd53 req-91437226-540a-435d-a966-c54683fe9e48 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0861c78-c249-4227-8253-6c23a25acd53 req-91437226-540a-435d-a966-c54683fe9e48 service nova] Acquiring lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0861c78-c249-4227-8253-6c23a25acd53 req-91437226-540a-435d-a966-c54683fe9e48 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0861c78-c249-4227-8253-6c23a25acd53 req-91437226-540a-435d-a966-c54683fe9e48 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0861c78-c249-4227-8253-6c23a25acd53 req-91437226-540a-435d-a966-c54683fe9e48 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] No waiting events found dispatching network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:50 user nova-compute[75216]: WARNING nova.compute.manager [req-d0861c78-c249-4227-8253-6c23a25acd53 req-91437226-540a-435d-a966-c54683fe9e48 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received unexpected event network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 for instance with vm_state building and task_state spawning.
Nov 02 04:45:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:45:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Instance spawned successfully.
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:45:52 user nova-compute[75216]: INFO nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-3284cbe3-e562-47e7-a523-8c694a85de58 req-8ea648af-c62a-4101-b51b-5c5d0d8d6343 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3284cbe3-e562-47e7-a523-8c694a85de58 req-8ea648af-c62a-4101-b51b-5c5d0d8d6343 service nova] Acquiring lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3284cbe3-e562-47e7-a523-8c694a85de58 req-8ea648af-c62a-4101-b51b-5c5d0d8d6343 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3284cbe3-e562-47e7-a523-8c694a85de58 req-8ea648af-c62a-4101-b51b-5c5d0d8d6343 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-3284cbe3-e562-47e7-a523-8c694a85de58 req-8ea648af-c62a-4101-b51b-5c5d0d8d6343 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] No waiting events found dispatching network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:45:52 user nova-compute[75216]: WARNING nova.compute.manager [req-3284cbe3-e562-47e7-a523-8c694a85de58 req-8ea648af-c62a-4101-b51b-5c5d0d8d6343 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received unexpected event network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 for instance with vm_state building and task_state spawning.
Nov 02 04:45:52 user nova-compute[75216]: INFO nova.compute.manager [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Took 6.45 seconds to build instance.
Nov 02 04:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8bcde78d-8d30-4fe8-a4bc-118620e0387a tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.566s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYqNvPWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:45:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:45:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:45:53 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a6b5ac-6784-49ef-9644-44afb4d76152]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:45:53 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[13835a7d-b775-4ec1-b23a-5477aa3b0a4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57] added
Nov 02 04:45:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3b604-1da7-4328-b7ce-73777575e5f1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[778b29d4-21d9-4142-bab0-6d29fc7fec9b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYqNvPWh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYqNvPWh" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1db74b1-b87b-4a3a-adc5-8ce433a292c2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYqNvPWh'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acdbaf3-c1b7-4320-a65f-97f1950bf28e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae0fb9-5900-46fb-899a-7b174a47a98a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdc2f44-016e-45cd-b813-33baad3a90e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260]
Nov 02 04:45:54 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260] successful.
Nov 02 04:45:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[949eac61-1def-49d7-8928-865803f9c808]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5023b-0599-4b83-bf4a-5bd8e30ec57a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:45:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88543f49-e551-4bba-817b-43f3ad885ecd]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:45:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYqNvPWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26434666438303936', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434666438303936', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lazy-loading 'flavor' on Instance uuid 2bf23601-af5f-4d48-a99a-74230fb02935 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:45:55 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:45:55 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 04:45:55 user nova-compute[75216]:   <target dev="sdc" bus="scsi"/>
Nov 02 04:45:55 user nova-compute[75216]:   <serial>ab19b245-b00b-40ce-a30b-fc7a68442e57</serial>
Nov 02 04:45:55 user nova-compute[75216]:   <address type="drive" controller="0" unit="2"/>
Nov 02 04:45:55 user nova-compute[75216]: </disk>
Nov 02 04:45:55 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] No BDM found with device name sda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:45:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] No VIF found with MAC fa:16:3e:f5:93:46, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:45:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:45:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:45:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (sdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "43182725-9f83-4afd-a243-49d838e7d811" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:46:03 user nova-compute[75216]: INFO nova.compute.claims [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Claim successful on node user
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:46:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:46:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:46:04 user nova-compute[75216]: INFO nova.virt.block_device [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Booting with blank volume at /dev/vda
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.policy [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae71d7b88da2452a9ec4489a0ef49176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6771c51304d446b8338d0d879ede48f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:04 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:46:04 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7757MB free_disk=25.289165496826172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Successfully created port: 1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 2bf23601-af5f-4d48-a99a-74230fb02935 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 521d9190-7056-42d2-a594-d1ae11b37798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance faf3ef57-71fb-4ba2-a817-497c40f649a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e31123e5-1b35-4456-af70-e6b3c058dae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 075b3db8-71aa-4bd7-8c7a-8cc5835594de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1790f117-7ae5-4b92-8c68-13d8da9f18ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:46:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Successfully updated port: 1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-changed-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Refreshing instance network info cache due to event network-changed-1e2b5f1c-63f6-4ba4-883d-c528768387a4. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] Acquiring lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating instance_info_cache with network_info: [{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance network_info: |[{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] Acquired lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:46:05 user nova-compute[75216]: DEBUG nova.network.neutron [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Refreshing network info cache for port 1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.network.neutron [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updated VIF entry in instance network info cache for port 1e2b5f1c-63f6-4ba4-883d-c528768387a4. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.network.neutron [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating instance_info_cache with network_info: [{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERAWkgGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:06 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:06 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:06 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6c9205a-b163-4511-9a62-14a67f52ab43 req-c85fb4cf-330f-4524-9292-df7ad9e90d64 service nova] Releasing lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f6fcc-2a91-446a-88f2-a0364b60488a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:06 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91270f4-660b-47b0-af62-556743507132]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017] added
Nov 02 04:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f522e-6d42-4415-b9c7-938e2c71e712]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330247d-f03b-47a9-9287-b57ce2cb1347]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERAWkgGj {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERAWkgGj" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb4d215-ed19-4bd8-8c07-e8c0115a7149]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERAWkgGj'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c464449a-12d7-44f9-90bb-a0ae58933b5c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3362be-8f7c-4984-a917-18be6f01e07b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: INFO nova.virt.block_device [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Booting with volume 471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 at /dev/vdc
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcde01a-04e3-44f5-808c-bd5033812d9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260]
Nov 02 04:46:06 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348001c-8a23-498a-b43c-9899cb3feefe]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed5babb-b5ac-47f9-961c-6db6f2ed3ca9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.058s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[207066c9-2d19-4705-ace5-1f20f6067179]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERAWkgGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-24af50aa-5573-457d-a47c-6874db9a624b tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.065s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.utils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9fcdaf-0c97-453e-b046-7909817c03cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3614a69e-58e6-4bf9-ae73-47b99a9f306f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f26252-ce48-4fa9-8655-98e5f02f3bad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b69cb25-dd1b-432c-b216-b061cfd5c6d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:07 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b98f24-12c0-4c44-aa9b-395a1fd5aeac]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.utils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating existing volume attachment record: cc487fde-d779-4f29-bd08-8e89d0b563b2 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26236333061303461', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236333061303461', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'flavor' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:46:07 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:07 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 02 04:46:07 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:46:07 user nova-compute[75216]:   <serial>87df26d5-dd3e-428c-8483-d0deb774e017</serial>
Nov 02 04:46:07 user nova-compute[75216]: </disk>
Nov 02 04:46:07 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] No VIF found with MAC fa:16:3e:a1:68:27, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQydpfDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:09 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[543214c1-3394-4eb7-aef9-2685f4097557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:09 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[74474bd4-3d08-4b3a-9896-2221547bd438]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95] added
Nov 02 04:46:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d239c-de19-4d3c-ab3d-acd1e75883f8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b18f17-f0df-4673-a0c7-a2f6492e7001]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQydpfDG {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQydpfDG" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ccc4d-81f2-4ad4-ac44-337cc78e9191]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MQydpfDG'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[006dcd4b-e62c-4572-8021-7ebce56fcfab]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b69f7a1-35db-4c7a-9370-eea7cf9bdddc tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.267s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed75a75-6e49-4f8e-a96b-7ee308063dfb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d529ea9-af69-4051-a55d-db6fbd85a959]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260]
Nov 02 04:46:09 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[91577766-bb60-4f2c-a070-307189a8a552]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98ba2a4-4c13-49af-b258-ededda5b7bad]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb463d-d8c8-4a94-932c-d899e30e2d7b]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQydpfDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26462393965643364', 'path': '/dev/sdf'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462393965643364', 'path': '/dev/sdf'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lazy-loading 'flavor' on Instance uuid faf3ef57-71fb-4ba2-a817-497c40f649a0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] attach device xml: <disk type="block" device="disk">
Nov 02 04:46:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:11 user nova-compute[75216]:   <source dev="/dev/sdf"/>
Nov 02 04:46:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:46:11 user nova-compute[75216]:   <serial>ad3fb7a6-1826-49bf-ac56-fc8650c8eb95</serial>
Nov 02 04:46:11 user nova-compute[75216]: </disk>
Nov 02 04:46:11 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:11 user nova-compute[75216]: INFO nova.compute.manager [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Detaching volume ab19b245-b00b-40ce-a30b-fc7a68442e57
Nov 02 04:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:11 user nova-compute[75216]: INFO nova.virt.block_device [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Attempting to driver detach volume ab19b245-b00b-40ce-a30b-fc7a68442e57 from mountpoint /dev/sdc
Nov 02 04:46:11 user nova-compute[75216]: INFO nova.compute.manager [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Detaching volume 87df26d5-dd3e-428c-8483-d0deb774e017
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Attempting to detach device sdc from instance 2bf23601-af5f-4d48-a99a-74230fb02935 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:46:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:11 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 04:46:11 user nova-compute[75216]:   <target dev="sdc" bus="scsi"/>
Nov 02 04:46:11 user nova-compute[75216]:   <serial>ab19b245-b00b-40ce-a30b-fc7a68442e57</serial>
Nov 02 04:46:11 user nova-compute[75216]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 04:46:11 user nova-compute[75216]: </disk>
Nov 02 04:46:11 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Successfully detached device sdc from instance 2bf23601-af5f-4d48-a99a-74230fb02935 from the persistent domain config.
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2bf23601-af5f-4d48-a99a-74230fb02935 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:46:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:11 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 04:46:11 user nova-compute[75216]:   <target dev="sdc" bus="scsi"/>
Nov 02 04:46:11 user nova-compute[75216]:   <serial>ab19b245-b00b-40ce-a30b-fc7a68442e57</serial>
Nov 02 04:46:11 user nova-compute[75216]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 04:46:11 user nova-compute[75216]: </disk>
Nov 02 04:46:11 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:11 user nova-compute[75216]: INFO nova.virt.block_device [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Attempting to driver detach volume 87df26d5-dd3e-428c-8483-d0deb774e017 from mountpoint /dev/vdb
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] No VIF found with MAC fa:16:3e:4d:5d:bb, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Attempting to detach device vdb from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:46:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:11 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 02 04:46:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:46:11 user nova-compute[75216]:   <serial>87df26d5-dd3e-428c-8483-d0deb774e017</serial>
Nov 02 04:46:11 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 04:46:11 user nova-compute[75216]: </disk>
Nov 02 04:46:11 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully detached device vdb from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the persistent domain config.
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:46:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:11 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 02 04:46:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:46:11 user nova-compute[75216]:   <serial>87df26d5-dd3e-428c-8483-d0deb774e017</serial>
Nov 02 04:46:11 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 04:46:11 user nova-compute[75216]: </disk>
Nov 02 04:46:11 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6dbc891b-3e8f-4005-a26d-a23334a8ada0 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.871s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2bf23601-af5f-4d48-a99a-74230fb02935 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG os_brick.utils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2841b0c-79de-464f-a43a-b314326e97eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[410976ec-83e0-4b9c-8794-83cb178dba79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a98c47-d113-416f-abae-9ab81777213e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa5db6-287c-4673-a371-ce7fb822b231]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:12 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:46:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee4d4e4-1f3f-47e6-93b5-34ab2d1b271c]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG os_brick.utils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating existing volume attachment record: 4149a010-0779-4265-9cc3-b9d0216686e0 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] volume_snapshot_create: create_info: {'snapshot_id': 'ca5be6f0-39db-4998-9a71-b4ab5302d155', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75216) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] snap xml: <domainsnapshot>
Nov 02 04:46:12 user nova-compute[75216]:   <disks>
Nov 02 04:46:12 user nova-compute[75216]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 02 04:46:12 user nova-compute[75216]:       <source file="/dev/new_file"/>
Nov 02 04:46:12 user nova-compute[75216]:     </disk>
Nov 02 04:46:12 user nova-compute[75216]:     <disk name="vda" snapshot="no"/>
Nov 02 04:46:12 user nova-compute[75216]:   </disks>
Nov 02 04:46:12 user nova-compute[75216]: </domainsnapshot>
Nov 02 04:46:12 user nova-compute[75216]:  {{(pid=75216) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 02 04:46:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] Lazy-loading 'system_metadata' on Instance uuid faf3ef57-71fb-4ba2-a817-497c40f649a0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Traceback (most recent call last):
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     rv = execute(f, *args, **kwargs)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     six.reraise(c, e, tb)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     raise value
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     rv = meth(*args, **kwargs)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] 
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Traceback (most recent call last):
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     self._volume_snapshot_create(context, instance, guest,
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     rv = execute(f, *args, **kwargs)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     six.reraise(c, e, tb)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     raise value
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     rv = meth(*args, **kwargs)
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] 
Nov 02 04:46:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0eebc21a-6df0-4b32-8399-678446f0dcfb tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] volume_snapshot_delete: delete_info: {'volume_id': 'ad3fb7a6-1826-49bf-ac56-fc8650c8eb95'} {{(pid=75216) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-0eebc21a-6df0-4b32-8399-678446f0dcfb tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Traceback (most recent call last):
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0]     if delete_info['type'] != 'qcow2':
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] KeyError: 'type'
Nov 02 04:46:12 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] 
Nov 02 04:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:16 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:16 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:16 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59792e-40d7-417f-8280-d337ddaf6ce9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:16 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2a06c8-213e-4d85-985f-c00e9a9e0ae1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813] added
Nov 02 04:46:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ca5be6f0-39db-4998-9a71-b4ab5302d155 could not be found.
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise value
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ca5be6f0-39db-4998-9a71-b4ab5302d155 could not be found. (HTTP 404) (Request-ID: req-1d7944b7-f25e-4c0c-ab68-9a86aec08643)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ca5be6f0-39db-4998-9a71-b4ab5302d155 could not be found.
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server [None req-b01e10c0-4c79-4a4d-b759-dbad5620e25f tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise value
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-0eebc21a-6df0-4b32-8399-678446f0dcfb tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-91c6cd6d-f1a7-4e90-8ef0-bda8d26680ce)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 04:46:16 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e3932-b299-4c4a-8585-509d63c7c103]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server [None req-0eebc21a-6df0-4b32-8399-678446f0dcfb tempest-VolumesAssistedSnapshotsTest-15091706 tempest-VolumesAssistedSnapshotsTest-15091706-project] Exception during message handling: KeyError: 'type'
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 02 04:46:16 user nova-compute[75216]: ERROR oslo_messaging.rpc.server 
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cf4b31-40bc-429e-9509-79f17f0a7d81]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UinCfPqh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UinCfPqh" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f3bd8-f237-4f13-83ff-6933e40d3fbd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UinCfPqh'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee09be-5860-43d4-b606-17d236bcd3cc]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb87159-f8ed-4a99-9ae7-ea29b7d82a2b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3656f25-94bb-45f1-919f-7a334132dfdd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]
Nov 02 04:46:16 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bec41e0-1899-4264-8858-7db8cbb83309]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc17ef5c-baba-4e6b-9a75-8b74933ae921]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf4bb78-3b67-4f09-b417-e80ace93a001]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:16 user nova-compute[75216]: INFO nova.compute.manager [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Detaching volume ad3fb7a6-1826-49bf-ac56-fc8650c8eb95
Nov 02 04:46:17 user nova-compute[75216]: INFO nova.virt.block_device [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Attempting to driver detach volume ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 from mountpoint /dev/vdb
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Attempting to detach device vdb from instance faf3ef57-71fb-4ba2-a817-497c40f649a0 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 04:46:17 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:17 user nova-compute[75216]:   <source dev="/dev/sdf"/>
Nov 02 04:46:17 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:46:17 user nova-compute[75216]:   <serial>ad3fb7a6-1826-49bf-ac56-fc8650c8eb95</serial>
Nov 02 04:46:17 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:46:17 user nova-compute[75216]: </disk>
Nov 02 04:46:17 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Successfully detached device vdb from instance faf3ef57-71fb-4ba2-a817-497c40f649a0 from the persistent domain config.
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance faf3ef57-71fb-4ba2-a817-497c40f649a0 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 04:46:17 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:17 user nova-compute[75216]:   <source dev="/dev/sdf"/>
Nov 02 04:46:17 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:46:17 user nova-compute[75216]:   <serial>ad3fb7a6-1826-49bf-ac56-fc8650c8eb95</serial>
Nov 02 04:46:17 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:46:17 user nova-compute[75216]: </disk>
Nov 02 04:46:17 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26666356166636661', 'path': '/dev/sdg'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666356166636661', 'path': '/dev/sdg'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.objects.instance [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lazy-loading 'flavor' on Instance uuid e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:46:17 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:17 user nova-compute[75216]:   <source dev="/dev/sdg"/>
Nov 02 04:46:17 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:46:17 user nova-compute[75216]:   <serial>7e2e1e7a-db6e-4165-9e67-b54579d54813</serial>
Nov 02 04:46:17 user nova-compute[75216]: </disk>
Nov 02 04:46:17 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance faf3ef57-71fb-4ba2-a817-497c40f649a0 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:46:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] No VIF found with MAC fa:16:3e:08:a1:be, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:46:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-55bf2417-3758-426f-a2d3-f5378ffb4d3b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.284s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6009ac-e5df-4cbf-ac9f-422a0928d95d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebedf262-61c4-4f8f-b72e-dc788f3e932d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82eeb71-8ae0-4618-ad69-f42d4a07c037]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc0a90-8cd7-4071-967f-529ec4670956]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:19 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:46:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70307a69-aeb2-4c5e-b965-57a7782f07ee]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:46:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:19 user nova-compute[75216]: INFO nova.compute.manager [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Swapping volume 7e2e1e7a-db6e-4165-9e67-b54579d54813 for 632e2d96-6fbb-4fed-a24f-a786b724f0d9
Nov 02 04:46:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:46:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Creating image(s)
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Ensure instance console log exists: /opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Start _get_guest_xml network_info=[{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'db798133-7ebb-4e37-8e37-221e32d58ead', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoCbihm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '075b3db8-71aa-4bd7-8c7a-8cc5835594de', 'attached_at': '', 'detached_at': '', 'volume_id': '212297cc-75e7-4f72-9840-454871258980', 'serial': '212297cc-75e7-4f72-9840-454871258980'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '9c768fe2-79f4-43d3-9ac3-f0ca4deadbc6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqiyGhgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '075b3db8-71aa-4bd7-8c7a-8cc5835594de', 'attached_at': '', 'detached_at': '', 'volume_id': '3211f4e2-6987-4b49-a1f7-04d87be936ed', 'serial': '3211f4e2-6987-4b49-a1f7-04d87be936ed'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': 'cc487fde-d779-4f29-bd08-8e89d0b563b2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDIKbYPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '075b3db8-71aa-4bd7-8c7a-8cc5835594de', 'attached_at': '', 'detached_at': '', 'volume_id': '471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4', 'serial': '471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:46:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:46:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoCbihm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:31 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:31 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:31 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a463ba-b03b-4019-846d-21c553f194af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:31 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e08e144-5ae6-4e09-9069-0a8b509c697d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980] added
Nov 02 04:46:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3405b8a8-2cf7-43b8-b57d-e5d29a54704f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bacdbb4-d825-460a-a9fe-54fa74b13573]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsoCbihm {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsoCbihm" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdcb938-d0d7-457e-9b66-bc1b93b8060d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jsoCbihm'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 2bf23601-af5f-4d48-a99a-74230fb02935 is timed out.
Nov 02 04:46:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Successfully detached device sdc from instance 2bf23601-af5f-4d48-a99a-74230fb02935 from the live domain config.
Nov 02 04:46:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYqNvPWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:31 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ebb91b-ae27-4077-ba35-c10cc4c311c0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c8fd2-abe7-4434-abc6-3d0b97671e9c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274849c-7690-4cf2-83bf-04241bbf325b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260]
Nov 02 04:46:32 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d3111c-af61-4a72-a759-c2ddf9a29e0c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03debe29-a928-4603-abb4-7fee2c551f98]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a1ec3-e92c-4bbe-a8de-565cd0dc3ff0]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoCbihm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:32 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 521d9190-7056-42d2-a594-d1ae11b37798 is timed out.
Nov 02 04:46:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully detached device vdb from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the live domain config.
Nov 02 04:46:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERAWkgGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:32 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23263313961333662', 'path': '/dev/sdh'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263313961333662', 'path': '/dev/sdh'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.271s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a19b1-59dd-4642-934d-339119b34b88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:46:33 user nova-compute[75216]: No targets found.
Nov 02 04:46:33 user nova-compute[75216]: iSNS:
Nov 02 04:46:33 user nova-compute[75216]: No targets found.
Nov 02 04:46:33 user nova-compute[75216]: STATIC:
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: FIRMWARE:
Nov 02 04:46:33 user nova-compute[75216]: No targets found.
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:46:33 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:46:33 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqiyGhgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1cfcef-45b7-4964-8ed1-c015af3a1dab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b53eac6-3791-4e60-957f-fec494af765a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5adbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b6900-ec7c-44ed-81a4-cb56f5fc5c4a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1abc7f-c7a8-491e-a188-2be9623c7a62]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe973271-dd82-4dea-9059-1a07db179df6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2123acdc-2ae8-4025-a286-1ba848649140]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d60c0-9cb6-4e2d-93b1-7bc5c562b37c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.117s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[016fe729-18c8-42d6-927d-9d0bfaa10a22]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260]
Nov 02 04:46:33 user nova-compute[75216]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab19b245-b00b-40ce-a30b-fc7a68442e57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ae7cbd-495e-48fe-8e6f-53bec0b2a8b3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] <== disconnect_volume: return (1735ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.449s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[455706f9-6924-4513-9465-b30e5cb30227]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:46:33 user nova-compute[75216]: No targets found.
Nov 02 04:46:33 user nova-compute[75216]: iSNS:
Nov 02 04:46:33 user nova-compute[75216]: No targets found.
Nov 02 04:46:33 user nova-compute[75216]: STATIC:
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017
Nov 02 04:46:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:33 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:33 user nova-compute[75216]: FIRMWARE:
Nov 02 04:46:33 user nova-compute[75216]: No targets found.
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:46:33 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:46:33 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529a68c-6c14-43c8-9b8a-c33f93646987]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dac4aa-68b1-4833-843b-bdece5350237]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5a3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42f0537-8dc2-4374-9de9-df48043c08be]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b0d3c-61a8-4191-867c-b79e918e8cb2]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73241d6-5599-48d8-b7ad-28404968eba5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571c0fa-2fe9-4bad-a025-66251b95f0c6]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3eb470-1327-40ad-8d0e-445e35cb66b3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c1407b-1f2a-4410-a3dc-57e6dd9c63ee]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260]
Nov 02 04:46:33 user nova-compute[75216]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87df26d5-dd3e-428c-8483-d0deb774e017 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4cf888-6403-4c43-84b6-99b2cbe47be3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] <== disconnect_volume: return (1827ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.815s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:34 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:34 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49554fe-9b6c-4084-b94d-4a09efe52f2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:34 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a53e908-d72b-4736-b41a-be3700d8ba33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed] added
Nov 02 04:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd94193-8c74-46f6-b1bf-ba06dda66817]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aaad85-e5f8-4223-aedd-ce00cfbe6e58]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqiyGhgx {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqiyGhgx" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8f5d38-4cb7-4f8f-bcef-64a4ae0ec079]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SqiyGhgx'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457db7f-bb1c-4f14-b847-35e7b5fd7006]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6dd404-0a55-40f1-8cc1-662aeef72972]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6e7753-e76a-4980-a930-167ba90f07fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260]
Nov 02 04:46:34 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9442fcfd-8502-4c4e-8d92-1cb88c0ad2db]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[983397a5-bd1e-463a-8bed-b319311ddc4d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c26ff5-1ed6-4bf4-adc2-c51a7ef2311e]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqiyGhgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== connect_volume: return (2179ms) {'type': 'block', 'scsi_wwn': '23936663762383036', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936663762383036', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDIKbYPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:35 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbed1e-c5a2-427f-82a9-061624fbe2cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:35 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e151ea-1cd5-413c-8ac8-9666e7998775]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4] added
Nov 02 04:46:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0add0-1dd8-47fe-9921-71d72e53bde4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae2f757-5235-434c-91ee-17f563ad4c08]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDIKbYPi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDIKbYPi" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f508e6f-ae2e-412e-a75f-048c3116ac46]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FDIKbYPi'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16288143-9c38-49fe-a5f4-ac8ee7415479]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11fc8b-7f47-49c5-bd1b-013473ce2fc2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c01c5c-7c24-4ad3-843d-552544ab52ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260]
Nov 02 04:46:35 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b35e866-0b32-46e9-a3e9-54fc3410f250]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c790bd62-16f5-41c5-a7a9-00f2d96c6d5e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1cd079-fc20-4b82-9f01-8c98d3fa82ef]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDIKbYPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23363383262663966', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363383262663966', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:1c:39,bridge_name='br-int',has_traffic_filtering=True,id=fd720d4c-a08a-4b78-8d45-b88d578d6c42,network=Network(2b311a5d-7f13-40ce-b866-8b802e105479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd720d4c-a0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=fa0c4ab6-2102-4768-ab8a-9f4c62ccec07,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa0c4ab6-21') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:bc,bridge_name='br-int',has_traffic_filtering=True,id=3c0eac1c-1239-4eb3-b17d-59a8108676e3,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c0eac1c-12') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:59:90,bridge_name='br-int',has_traffic_filtering=True,id=25a7183c-696f-4591-a10e-c7b247ce24f8,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a7183c-69') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:1b:f7,bridge_name='br-int',has_traffic_filtering=True,id=401a8b69-4f19-4848-8643-e69bce5bf926,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401a8b69-4f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:23,bridge_name='br-int',has_traffic_filtering=True,id=ad9448fb-8767-4ee1-8f84-d004f78ce062,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9448fb-87') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:11:46,bridge_name='br-int',has_traffic_filtering=True,id=3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ebfabc4-4c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lazy-loading 'pci_devices' on Instance uuid 075b3db8-71aa-4bd7-8c7a-8cc5835594de {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:46:36 user nova-compute[75216]:   <uuid>075b3db8-71aa-4bd7-8c7a-8cc5835594de</uuid>
Nov 02 04:46:36 user nova-compute[75216]:   <name>instance-0000000a</name>
Nov 02 04:46:36 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:46:36 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:46:36 user nova-compute[75216]:   <metadata>
Nov 02 04:46:36 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:46:36 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:46:36 user nova-compute[75216]:       <nova:name>tempest-device-tagging-server-1609511547</nova:name>
Nov 02 04:46:36 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:46:31</nova:creationTime>
Nov 02 04:46:36 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:46:36 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:46:36 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:46:36 user nova-compute[75216]:       <nova:owner>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:user uuid="4bfecda6e9e74983bbfc99909cd4f53c">tempest-TaggedBootDevicesTest-684275739-project-member</nova:user>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:project uuid="9bf82914e81741ce84c804211ad49e7d">tempest-TaggedBootDevicesTest-684275739</nova:project>
Nov 02 04:46:36 user nova-compute[75216]:       </nova:owner>
Nov 02 04:46:36 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:46:36 user nova-compute[75216]:       <nova:ports>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:port uuid="fd720d4c-a08a-4b78-8d45-b88d578d6c42">
Nov 02 04:46:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 04:46:36 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:port uuid="fa0c4ab6-2102-4768-ab8a-9f4c62ccec07">
Nov 02 04:46:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Nov 02 04:46:36 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:port uuid="3c0eac1c-1239-4eb3-b17d-59a8108676e3">
Nov 02 04:46:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Nov 02 04:46:36 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:port uuid="25a7183c-696f-4591-a10e-c7b247ce24f8">
Nov 02 04:46:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Nov 02 04:46:36 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:port uuid="401a8b69-4f19-4848-8643-e69bce5bf926">
Nov 02 04:46:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Nov 02 04:46:36 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:port uuid="ad9448fb-8767-4ee1-8f84-d004f78ce062">
Nov 02 04:46:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 04:46:36 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:36 user nova-compute[75216]:         <nova:port uuid="3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e">
Nov 02 04:46:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 04:46:36 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:36 user nova-compute[75216]:       </nova:ports>
Nov 02 04:46:36 user nova-compute[75216]:     </nova:instance>
Nov 02 04:46:36 user nova-compute[75216]:   </metadata>
Nov 02 04:46:36 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:46:36 user nova-compute[75216]:     <system>
Nov 02 04:46:36 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:46:36 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:46:36 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:46:36 user nova-compute[75216]:       <entry name="serial">075b3db8-71aa-4bd7-8c7a-8cc5835594de</entry>
Nov 02 04:46:36 user nova-compute[75216]:       <entry name="uuid">075b3db8-71aa-4bd7-8c7a-8cc5835594de</entry>
Nov 02 04:46:36 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:46:36 user nova-compute[75216]:     </system>
Nov 02 04:46:36 user nova-compute[75216]:   </sysinfo>
Nov 02 04:46:36 user nova-compute[75216]:   <os>
Nov 02 04:46:36 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:46:36 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:46:36 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:46:36 user nova-compute[75216]:   </os>
Nov 02 04:46:36 user nova-compute[75216]:   <features>
Nov 02 04:46:36 user nova-compute[75216]:     <acpi/>
Nov 02 04:46:36 user nova-compute[75216]:     <apic/>
Nov 02 04:46:36 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:46:36 user nova-compute[75216]:   </features>
Nov 02 04:46:36 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:46:36 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:46:36 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:46:36 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:46:36 user nova-compute[75216]:   </clock>
Nov 02 04:46:36 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:46:36 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:46:36 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:46:36 user nova-compute[75216]:   </cpu>
Nov 02 04:46:36 user nova-compute[75216]:   <devices>
Nov 02 04:46:36 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 02 04:46:36 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 04:46:36 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de/disk.config"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="hda" bus="ide"/>
Nov 02 04:46:36 user nova-compute[75216]:     </disk>
Nov 02 04:46:36 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:46:36 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:36 user nova-compute[75216]:       <source dev="/dev/sdh"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <serial>212297cc-75e7-4f72-9840-454871258980</serial>
Nov 02 04:46:36 user nova-compute[75216]:     </disk>
Nov 02 04:46:36 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:46:36 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:36 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <serial>3211f4e2-6987-4b49-a1f7-04d87be936ed</serial>
Nov 02 04:46:36 user nova-compute[75216]:     </disk>
Nov 02 04:46:36 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:46:36 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:36 user nova-compute[75216]:       <source dev="/dev/sde"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="vdc" bus="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <serial>471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4</serial>
Nov 02 04:46:36 user nova-compute[75216]:     </disk>
Nov 02 04:46:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:36 user nova-compute[75216]:       <mac address="fa:16:3e:90:1c:39"/>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="tapfd720d4c-a0"/>
Nov 02 04:46:36 user nova-compute[75216]:     </interface>
Nov 02 04:46:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:36 user nova-compute[75216]:       <mac address="fa:16:3e:5c:9f:cb"/>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="tapfa0c4ab6-21"/>
Nov 02 04:46:36 user nova-compute[75216]:     </interface>
Nov 02 04:46:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:36 user nova-compute[75216]:       <mac address="fa:16:3e:fa:c9:bc"/>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="tap3c0eac1c-12"/>
Nov 02 04:46:36 user nova-compute[75216]:     </interface>
Nov 02 04:46:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:36 user nova-compute[75216]:       <mac address="fa:16:3e:e5:59:90"/>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="tap25a7183c-69"/>
Nov 02 04:46:36 user nova-compute[75216]:     </interface>
Nov 02 04:46:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:36 user nova-compute[75216]:       <mac address="fa:16:3e:63:1b:f7"/>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="tap401a8b69-4f"/>
Nov 02 04:46:36 user nova-compute[75216]:     </interface>
Nov 02 04:46:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:36 user nova-compute[75216]:       <mac address="fa:16:3e:05:74:23"/>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="tapad9448fb-87"/>
Nov 02 04:46:36 user nova-compute[75216]:     </interface>
Nov 02 04:46:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:36 user nova-compute[75216]:       <mac address="fa:16:3e:39:11:46"/>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:36 user nova-compute[75216]:       <target dev="tap3ebfabc4-4c"/>
Nov 02 04:46:36 user nova-compute[75216]:     </interface>
Nov 02 04:46:36 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:46:36 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de/console.log" append="off"/>
Nov 02 04:46:36 user nova-compute[75216]:     </serial>
Nov 02 04:46:36 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:46:36 user nova-compute[75216]:     <video>
Nov 02 04:46:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:36 user nova-compute[75216]:     </video>
Nov 02 04:46:36 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:46:36 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:46:36 user nova-compute[75216]:     </rng>
Nov 02 04:46:36 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:46:36 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:46:36 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:46:36 user nova-compute[75216]:     </memballoon>
Nov 02 04:46:36 user nova-compute[75216]:   </devices>
Nov 02 04:46:36 user nova-compute[75216]: </domain>
Nov 02 04:46:36 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:1c:39,bridge_name='br-int',has_traffic_filtering=True,id=fd720d4c-a08a-4b78-8d45-b88d578d6c42,network=Network(2b311a5d-7f13-40ce-b866-8b802e105479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd720d4c-a0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:1c:39,bridge_name='br-int',has_traffic_filtering=True,id=fd720d4c-a08a-4b78-8d45-b88d578d6c42,network=Network(2b311a5d-7f13-40ce-b866-8b802e105479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd720d4c-a0') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bf28a5c-df08-574d-8657-7b76e89bc45c', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd720d4c-a0, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd720d4c-a0, col_values=(('qos', UUID('43ed002c-0d2f-4e5f-a86a-67738e08fe4c')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd720d4c-a0, col_values=(('external_ids', {'iface-id': 'fd720d4c-a08a-4b78-8d45-b88d578d6c42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:1c:39', 'vm-uuid': '075b3db8-71aa-4bd7-8c7a-8cc5835594de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: INFO os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:1c:39,bridge_name='br-int',has_traffic_filtering=True,id=fd720d4c-a08a-4b78-8d45-b88d578d6c42,network=Network(2b311a5d-7f13-40ce-b866-8b802e105479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd720d4c-a0')
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=fa0c4ab6-2102-4768-ab8a-9f4c62ccec07,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa0c4ab6-21') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=fa0c4ab6-2102-4768-ab8a-9f4c62ccec07,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa0c4ab6-21') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77efbdc4-588c-5e87-985a-ecb8ca048fbd', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa0c4ab6-21, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa0c4ab6-21, col_values=(('qos', UUID('889e605b-6bd6-4bbe-9a4a-a46f749af80d')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa0c4ab6-21, col_values=(('external_ids', {'iface-id': 'fa0c4ab6-2102-4768-ab8a-9f4c62ccec07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:9f:cb', 'vm-uuid': '075b3db8-71aa-4bd7-8c7a-8cc5835594de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:36 user nova-compute[75216]: INFO os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=fa0c4ab6-2102-4768-ab8a-9f4c62ccec07,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa0c4ab6-21')
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:bc,bridge_name='br-int',has_traffic_filtering=True,id=3c0eac1c-1239-4eb3-b17d-59a8108676e3,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c0eac1c-12') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:36 user nova-compute[75216]: DEBUG os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:bc,bridge_name='br-int',has_traffic_filtering=True,id=3c0eac1c-1239-4eb3-b17d-59a8108676e3,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c0eac1c-12') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10e1a7b2-e3f8-5cbf-b26c-26ba9e411b4d', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c0eac1c-12, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c0eac1c-12, col_values=(('qos', UUID('cd0f6c96-45fc-425b-8c30-0d02495ec3ae')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c0eac1c-12, col_values=(('external_ids', {'iface-id': '3c0eac1c-1239-4eb3-b17d-59a8108676e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:c9:bc', 'vm-uuid': '075b3db8-71aa-4bd7-8c7a-8cc5835594de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: INFO os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:bc,bridge_name='br-int',has_traffic_filtering=True,id=3c0eac1c-1239-4eb3-b17d-59a8108676e3,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c0eac1c-12')
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:59:90,bridge_name='br-int',has_traffic_filtering=True,id=25a7183c-696f-4591-a10e-c7b247ce24f8,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a7183c-69') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:59:90,bridge_name='br-int',has_traffic_filtering=True,id=25a7183c-696f-4591-a10e-c7b247ce24f8,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a7183c-69') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29458f46-7761-5f96-be47-66fa23b691cb', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25a7183c-69, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25a7183c-69, col_values=(('qos', UUID('3ad7ee7d-cb03-4333-8d39-9b046748924f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25a7183c-69, col_values=(('external_ids', {'iface-id': '25a7183c-696f-4591-a10e-c7b247ce24f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:59:90', 'vm-uuid': '075b3db8-71aa-4bd7-8c7a-8cc5835594de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: INFO os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:59:90,bridge_name='br-int',has_traffic_filtering=True,id=25a7183c-696f-4591-a10e-c7b247ce24f8,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a7183c-69')
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:1b:f7,bridge_name='br-int',has_traffic_filtering=True,id=401a8b69-4f19-4848-8643-e69bce5bf926,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401a8b69-4f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:1b:f7,bridge_name='br-int',has_traffic_filtering=True,id=401a8b69-4f19-4848-8643-e69bce5bf926,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401a8b69-4f') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f3726ec-8663-575b-85cc-925af42ce339', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap401a8b69-4f, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap401a8b69-4f, col_values=(('qos', UUID('d78e8cbd-4c4f-481a-a37c-774e97be824b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap401a8b69-4f, col_values=(('external_ids', {'iface-id': '401a8b69-4f19-4848-8643-e69bce5bf926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:1b:f7', 'vm-uuid': '075b3db8-71aa-4bd7-8c7a-8cc5835594de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: INFO os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:1b:f7,bridge_name='br-int',has_traffic_filtering=True,id=401a8b69-4f19-4848-8643-e69bce5bf926,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401a8b69-4f')
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:23,bridge_name='br-int',has_traffic_filtering=True,id=ad9448fb-8767-4ee1-8f84-d004f78ce062,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9448fb-87') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:23,bridge_name='br-int',has_traffic_filtering=True,id=ad9448fb-8767-4ee1-8f84-d004f78ce062,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9448fb-87') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa58f8b0-096b-5baa-8e29-8ddfe24085ce', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad9448fb-87, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad9448fb-87, col_values=(('qos', UUID('cc24c40f-31a2-43a1-9dd9-a0fcde5ad1a3')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad9448fb-87, col_values=(('external_ids', {'iface-id': 'ad9448fb-8767-4ee1-8f84-d004f78ce062', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:74:23', 'vm-uuid': '075b3db8-71aa-4bd7-8c7a-8cc5835594de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: INFO os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:23,bridge_name='br-int',has_traffic_filtering=True,id=ad9448fb-8767-4ee1-8f84-d004f78ce062,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9448fb-87')
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:11:46,bridge_name='br-int',has_traffic_filtering=True,id=3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ebfabc4-4c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:11:46,bridge_name='br-int',has_traffic_filtering=True,id=3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ebfabc4-4c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a8f10f4-6627-52cc-9dab-e60b829d447a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ebfabc4-4c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ebfabc4-4c, col_values=(('qos', UUID('51dd196a-1fe5-4fdf-8774-09d528eaec1f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ebfabc4-4c, col_values=(('external_ids', {'iface-id': '3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:11:46', 'vm-uuid': '075b3db8-71aa-4bd7-8c7a-8cc5835594de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:37 user nova-compute[75216]: INFO os_vif [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:11:46,bridge_name='br-int',has_traffic_filtering=True,id=3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ebfabc4-4c')
Nov 02 04:46:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance faf3ef57-71fb-4ba2-a817-497c40f649a0 is timed out.
Nov 02 04:46:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Successfully detached device vdb from instance faf3ef57-71fb-4ba2-a817-497c40f649a0 from the live domain config.
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQydpfDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:37 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] No VIF found with MAC fa:16:3e:90:1c:39, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] No VIF found with MAC fa:16:3e:63:1b:f7, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:46:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Using config drive
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5b348d-30de-4df7-aa32-66535f3d5592]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:46:37 user nova-compute[75216]: No targets found.
Nov 02 04:46:37 user nova-compute[75216]: iSNS:
Nov 02 04:46:37 user nova-compute[75216]: No targets found.
Nov 02 04:46:37 user nova-compute[75216]: STATIC:
Nov 02 04:46:37 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:46:37 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:37 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:37 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed
Nov 02 04:46:37 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:37 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:37 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:46:37 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:37 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:37 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980
Nov 02 04:46:37 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:37 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:37 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:46:37 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:37 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:37 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4
Nov 02 04:46:37 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:37 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:37 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95
Nov 02 04:46:37 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:46:37 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:46:37 user nova-compute[75216]: FIRMWARE:
Nov 02 04:46:37 user nova-compute[75216]: No targets found.
Nov 02 04:46:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:46:37 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:46:37 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a309bb-f2a4-4c03-90e7-c317930f1605]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d787ec-7f8a-46a6-9e2a-4f002bceb669]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460426bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95'): ({'sdf'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Removing single pathed devices sdf {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5901df9-40b1-4d84-993c-82380feb1809]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4465efc7-30ab-4e39-a2cf-fd7fe116464c]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Flushing IO for device /dev/sdf {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d121844f-a77d-4c5f-be82-d8de20bc2b0f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7838f98d-4aae-4aff-a184-13e6d3f2ad24]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[25526117-fa94-4843-84d5-e3d0d3580fb8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Creating config drive at /opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de/disk.config
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy7_r4gak {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e397b71-3351-40ec-b486-e7eb2fb72be9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260]
Nov 02 04:46:38 user nova-compute[75216]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy7_r4gak" returned: 0 in 0.070s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3fb7a6-1826-49bf-ac56-fc8650c8eb95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f04ae6-bab4-453d-a1e5-fe4c7310c498]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] <== disconnect_volume: return (416ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'flavor' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c380857-3c61-4964-95d2-1a54f199b1c4 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.546s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "interface-521d9190-7056-42d2-a594-d1ae11b37798-c46e7044-1d57-4413-890f-5099026b4aa5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "interface-521d9190-7056-42d2-a594-d1ae11b37798-c46e7044-1d57-4413-890f-5099026b4aa5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'flavor' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converting VIF {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Attempting to detach device tapc46e7044-1d from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] detach device xml: <interface type="ethernet">
Nov 02 04:46:39 user nova-compute[75216]:   <mac address="fa:16:3e:f0:57:07"/>
Nov 02 04:46:39 user nova-compute[75216]:   <model type="virtio"/>
Nov 02 04:46:39 user nova-compute[75216]:   <mtu size="1442"/>
Nov 02 04:46:39 user nova-compute[75216]:   <target dev="tapc46e7044-1d"/>
Nov 02 04:46:39 user nova-compute[75216]: </interface>
Nov 02 04:46:39 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 04:46:39 user nova-compute[75216]:   <name>instance-00000007</name>
Nov 02 04:46:39 user nova-compute[75216]:   <uuid>521d9190-7056-42d2-a594-d1ae11b37798</uuid>
Nov 02 04:46:39 user nova-compute[75216]:   <metadata>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:46:39 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 02 04:46:39 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:46:39 user nova-compute[75216]:   <nova:creationTime>2023-11-02 04:45:33</nova:creationTime>
Nov 02 04:46:39 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 02 04:46:39 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 02 04:46:39 user nova-compute[75216]:   </nova:flavor>
Nov 02 04:46:39 user nova-compute[75216]:   <nova:owner>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:46:39 user nova-compute[75216]:   </nova:owner>
Nov 02 04:46:39 user nova-compute[75216]:   <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:46:39 user nova-compute[75216]:   <nova:ports>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:46:39 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:46:39 user nova-compute[75216]:     </nova:port>
Nov 02 04:46:39 user nova-compute[75216]:     <nova:port uuid="c46e7044-1d57-4413-890f-5099026b4aa5">
Nov 02 04:46:39 user nova-compute[75216]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Nov 02 04:46:39 user nova-compute[75216]:     </nova:port>
Nov 02 04:46:39 user nova-compute[75216]:   </nova:ports>
Nov 02 04:46:39 user nova-compute[75216]: </nova:instance>
Nov 02 04:46:39 user nova-compute[75216]:   </metadata>
Nov 02 04:46:39 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 02 04:46:39 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 04:46:39 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 02 04:46:39 user nova-compute[75216]:   <resource>
Nov 02 04:46:39 user nova-compute[75216]:     <partition>/machine</partition>
Nov 02 04:46:39 user nova-compute[75216]:   </resource>
Nov 02 04:46:39 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 02 04:46:39 user nova-compute[75216]:     <system>
Nov 02 04:46:39 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 04:46:39 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 04:46:39 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 02 04:46:39 user nova-compute[75216]:       <entry name='serial'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:46:39 user nova-compute[75216]:       <entry name='uuid'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:46:39 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 02 04:46:39 user nova-compute[75216]:     </system>
Nov 02 04:46:39 user nova-compute[75216]:   </sysinfo>
Nov 02 04:46:39 user nova-compute[75216]:   <os>
Nov 02 04:46:39 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 04:46:39 user nova-compute[75216]:     <boot dev='hd'/>
Nov 02 04:46:39 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 02 04:46:39 user nova-compute[75216]:   </os>
Nov 02 04:46:39 user nova-compute[75216]:   <features>
Nov 02 04:46:39 user nova-compute[75216]:     <acpi/>
Nov 02 04:46:39 user nova-compute[75216]:     <apic/>
Nov 02 04:46:39 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 02 04:46:39 user nova-compute[75216]:   </features>
Nov 02 04:46:39 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 04:46:39 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 02 04:46:39 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 04:46:39 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 02 04:46:39 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 02 04:46:39 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 02 04:46:39 user nova-compute[75216]:   </cpu>
Nov 02 04:46:39 user nova-compute[75216]:   <clock offset='utc'>
Nov 02 04:46:39 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 04:46:39 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 04:46:39 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 02 04:46:39 user nova-compute[75216]:   </clock>
Nov 02 04:46:39 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 02 04:46:39 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 02 04:46:39 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 02 04:46:39 user nova-compute[75216]:   <devices>
Nov 02 04:46:39 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 04:46:39 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 02 04:46:39 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 04:46:39 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk' index='2'/>
Nov 02 04:46:39 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 02 04:46:39 user nova-compute[75216]:         <format type='raw'/>
Nov 02 04:46:39 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec'/>
Nov 02 04:46:39 user nova-compute[75216]:         <backingStore/>
Nov 02 04:46:39 user nova-compute[75216]:       </backingStore>
Nov 02 04:46:39 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </disk>
Nov 02 04:46:39 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 02 04:46:39 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 04:46:39 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config' index='1'/>
Nov 02 04:46:39 user nova-compute[75216]:       <backingStore/>
Nov 02 04:46:39 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 02 04:46:39 user nova-compute[75216]:       <readonly/>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </disk>
Nov 02 04:46:39 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='usb'/>
Nov 02 04:46:39 user nova-compute[75216]:     </controller>
Nov 02 04:46:39 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </controller>
Nov 02 04:46:39 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='ide'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 04:46:39 user nova-compute[75216]:     </controller>
Nov 02 04:46:39 user nova-compute[75216]:     <interface type='ethernet'>
Nov 02 04:46:39 user nova-compute[75216]:       <mac address='fa:16:3e:a1:68:27'/>
Nov 02 04:46:39 user nova-compute[75216]:       <target dev='tap9df687c6-2d'/>
Nov 02 04:46:39 user nova-compute[75216]:       <model type='virtio'/>
Nov 02 04:46:39 user nova-compute[75216]:       <mtu size='1442'/>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='net0'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </interface>
Nov 02 04:46:39 user nova-compute[75216]:     <interface type='ethernet'>
Nov 02 04:46:39 user nova-compute[75216]:       <mac address='fa:16:3e:f0:57:07'/>
Nov 02 04:46:39 user nova-compute[75216]:       <target dev='tapc46e7044-1d'/>
Nov 02 04:46:39 user nova-compute[75216]:       <model type='virtio'/>
Nov 02 04:46:39 user nova-compute[75216]:       <mtu size='1442'/>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='net1'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </interface>
Nov 02 04:46:39 user nova-compute[75216]:     <serial type='pty'>
Nov 02 04:46:39 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:46:39 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:46:39 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 02 04:46:39 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 02 04:46:39 user nova-compute[75216]:       </target>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </serial>
Nov 02 04:46:39 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 04:46:39 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:46:39 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:46:39 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </console>
Nov 02 04:46:39 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='input0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </input>
Nov 02 04:46:39 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='input1'/>
Nov 02 04:46:39 user nova-compute[75216]:     </input>
Nov 02 04:46:39 user nova-compute[75216]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 04:46:39 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </graphics>
Nov 02 04:46:39 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 02 04:46:39 user nova-compute[75216]:     <video>
Nov 02 04:46:39 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='video0'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </video>
Nov 02 04:46:39 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 02 04:46:39 user nova-compute[75216]:       <stats period='10'/>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </memballoon>
Nov 02 04:46:39 user nova-compute[75216]:     <rng model='virtio'>
Nov 02 04:46:39 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 02 04:46:39 user nova-compute[75216]:       <alias name='rng0'/>
Nov 02 04:46:39 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 04:46:39 user nova-compute[75216]:     </rng>
Nov 02 04:46:39 user nova-compute[75216]:   </devices>
Nov 02 04:46:39 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 04:46:39 user nova-compute[75216]:     <label>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</label>
Nov 02 04:46:39 user nova-compute[75216]:     <imagelabel>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</imagelabel>
Nov 02 04:46:39 user nova-compute[75216]:   </seclabel>
Nov 02 04:46:39 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 04:46:39 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 02 04:46:39 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 04:46:39 user nova-compute[75216]:   </seclabel>
Nov 02 04:46:39 user nova-compute[75216]: </domain>
Nov 02 04:46:39 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 04:46:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully detached device tapc46e7044-1d from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the persistent domain config.
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] (1/8): Attempting to detach device tapc46e7044-1d with device alias net1 from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] detach device xml: <interface type="ethernet">
Nov 02 04:46:39 user nova-compute[75216]:   <mac address="fa:16:3e:f0:57:07"/>
Nov 02 04:46:39 user nova-compute[75216]:   <model type="virtio"/>
Nov 02 04:46:39 user nova-compute[75216]:   <mtu size="1442"/>
Nov 02 04:46:39 user nova-compute[75216]:   <target dev="tapc46e7044-1d"/>
Nov 02 04:46:39 user nova-compute[75216]: </interface>
Nov 02 04:46:39 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lazy-loading 'flavor' on Instance uuid 2bf23601-af5f-4d48-a99a-74230fb02935 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e2b376d-f4f0-4957-a988-6a02b16c195e tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.519s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Start waiting for the detach event from libvirt for device tapc46e7044-1d with device alias net1 for instance 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:46:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Creating image(s)
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Ensure instance console log exists: /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Start _get_guest_xml network_info=[{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '4149a010-0779-4265-9cc3-b9d0216686e0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYWhSnDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43182725-9f83-4afd-a243-49d838e7d811', 'attached_at': '', 'detached_at': '', 'volume_id': '4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'serial': '4aa6dbad-6e4d-4a4d-925b-023e12f174e1'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:46:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:46:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYWhSnDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:39 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e934132c-143a-407e-92fb-02ef956617c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:39 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.072s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6154a3e3-f597-4194-91fc-4e7538a9aefd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1] added
Nov 02 04:46:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b7adbd-84cd-49bc-9b88-1344c98248b5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b7d072-5048-4fde-b96c-35f88ab8591c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-b8ce4589-a9a9-4d04-8036-2e6442269380 req-2fdbbfa2-ad0c-4cb1-98cc-82f567ef1f31 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b8ce4589-a9a9-4d04-8036-2e6442269380 req-2fdbbfa2-ad0c-4cb1-98cc-82f567ef1f31 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b8ce4589-a9a9-4d04-8036-2e6442269380 req-2fdbbfa2-ad0c-4cb1-98cc-82f567ef1f31 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b8ce4589-a9a9-4d04-8036-2e6442269380 req-2fdbbfa2-ad0c-4cb1-98cc-82f567ef1f31 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-b8ce4589-a9a9-4d04-8036-2e6442269380 req-2fdbbfa2-ad0c-4cb1-98cc-82f567ef1f31 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:40 user nova-compute[75216]: WARNING nova.compute.manager [req-b8ce4589-a9a9-4d04-8036-2e6442269380 req-2fdbbfa2-ad0c-4cb1-98cc-82f567ef1f31 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 for instance with vm_state building and task_state spawning.
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYWhSnDV {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYWhSnDV" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc34414-b3cb-4263-9314-cb9319a4c5c2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cYWhSnDV'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cea6722-ca71-40e0-a09a-5c8812ef1912]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6025c1-60d9-408e-9e0d-10aebc7dc483]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-41a19127-25aa-4df2-b117-ee95b3bb6aba req-648b8938-5822-41e5-b196-946872121026 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-unplugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-41a19127-25aa-4df2-b117-ee95b3bb6aba req-648b8938-5822-41e5-b196-946872121026 service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-41a19127-25aa-4df2-b117-ee95b3bb6aba req-648b8938-5822-41e5-b196-946872121026 service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-41a19127-25aa-4df2-b117-ee95b3bb6aba req-648b8938-5822-41e5-b196-946872121026 service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-41a19127-25aa-4df2-b117-ee95b3bb6aba req-648b8938-5822-41e5-b196-946872121026 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-unplugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:40 user nova-compute[75216]: WARNING nova.compute.manager [req-41a19127-25aa-4df2-b117-ee95b3bb6aba req-648b8938-5822-41e5-b196-946872121026 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received unexpected event network-vif-unplugged-c46e7044-1d57-4413-890f-5099026b4aa5 for instance with vm_state active and task_state None.
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4107c505-d953-4419-8a8e-402fc852aafd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260]
Nov 02 04:46:40 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f5aae-f2ce-489b-a970-94b411e2fafb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23a1155-d4b1-445e-b8d8-18b8727fc148]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c8e46-9e45-485c-8a50-5e2071a40ccd]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYWhSnDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c10f72a-96ef-4eac-a325-3f662c793db9 req-9a461ad4-e48b-4841-9f34-87d3a0ca5a02 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c10f72a-96ef-4eac-a325-3f662c793db9 req-9a461ad4-e48b-4841-9f34-87d3a0ca5a02 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c10f72a-96ef-4eac-a325-3f662c793db9 req-9a461ad4-e48b-4841-9f34-87d3a0ca5a02 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c10f72a-96ef-4eac-a325-3f662c793db9 req-9a461ad4-e48b-4841-9f34-87d3a0ca5a02 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c10f72a-96ef-4eac-a325-3f662c793db9 req-9a461ad4-e48b-4841-9f34-87d3a0ca5a02 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:40 user nova-compute[75216]: WARNING nova.compute.manager [req-8c10f72a-96ef-4eac-a325-3f662c793db9 req-9a461ad4-e48b-4841-9f34-87d3a0ca5a02 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 for instance with vm_state building and task_state spawning.
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: INFO nova.compute.manager [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Terminating instance
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lazy-loading 'flavor' on Instance uuid faf3ef57-71fb-4ba2-a817-497c40f649a0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-610cd540-3258-44ce-a25e-72e7d686f346 tempest-VolumesAssistedSnapshotsTest-1307214404 tempest-VolumesAssistedSnapshotsTest-1307214404-project-admin] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.103s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23433303833353565', 'path': '/dev/sdf'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303833353565', 'path': '/dev/sdf'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-662356066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-662356066',id=12,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-50m6mqgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:46:04Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=43182725-9f83-4afd-a243-49d838e7d811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'pci_devices' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:46:41 user nova-compute[75216]:   <uuid>43182725-9f83-4afd-a243-49d838e7d811</uuid>
Nov 02 04:46:41 user nova-compute[75216]:   <name>instance-0000000c</name>
Nov 02 04:46:41 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:46:41 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:46:41 user nova-compute[75216]:   <metadata>
Nov 02 04:46:41 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:46:41 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:46:41 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-662356066</nova:name>
Nov 02 04:46:41 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:46:39</nova:creationTime>
Nov 02 04:46:41 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:46:41 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:46:41 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:46:41 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:46:41 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:46:41 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:46:41 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:46:41 user nova-compute[75216]:       <nova:owner>
Nov 02 04:46:41 user nova-compute[75216]:         <nova:user uuid="ae71d7b88da2452a9ec4489a0ef49176">tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member</nova:user>
Nov 02 04:46:41 user nova-compute[75216]:         <nova:project uuid="f6771c51304d446b8338d0d879ede48f">tempest-ServerBootFromVolumeStableRescueTest-1501080447</nova:project>
Nov 02 04:46:41 user nova-compute[75216]:       </nova:owner>
Nov 02 04:46:41 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:46:41 user nova-compute[75216]:       <nova:ports>
Nov 02 04:46:41 user nova-compute[75216]:         <nova:port uuid="1e2b5f1c-63f6-4ba4-883d-c528768387a4">
Nov 02 04:46:41 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 04:46:41 user nova-compute[75216]:         </nova:port>
Nov 02 04:46:41 user nova-compute[75216]:       </nova:ports>
Nov 02 04:46:41 user nova-compute[75216]:     </nova:instance>
Nov 02 04:46:41 user nova-compute[75216]:   </metadata>
Nov 02 04:46:41 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:46:41 user nova-compute[75216]:     <system>
Nov 02 04:46:41 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:46:41 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:46:41 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:46:41 user nova-compute[75216]:       <entry name="serial">43182725-9f83-4afd-a243-49d838e7d811</entry>
Nov 02 04:46:41 user nova-compute[75216]:       <entry name="uuid">43182725-9f83-4afd-a243-49d838e7d811</entry>
Nov 02 04:46:41 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:46:41 user nova-compute[75216]:     </system>
Nov 02 04:46:41 user nova-compute[75216]:   </sysinfo>
Nov 02 04:46:41 user nova-compute[75216]:   <os>
Nov 02 04:46:41 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:46:41 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:46:41 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:46:41 user nova-compute[75216]:   </os>
Nov 02 04:46:41 user nova-compute[75216]:   <features>
Nov 02 04:46:41 user nova-compute[75216]:     <acpi/>
Nov 02 04:46:41 user nova-compute[75216]:     <apic/>
Nov 02 04:46:41 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:46:41 user nova-compute[75216]:   </features>
Nov 02 04:46:41 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:46:41 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:46:41 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:46:41 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:46:41 user nova-compute[75216]:   </clock>
Nov 02 04:46:41 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:46:41 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:46:41 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:46:41 user nova-compute[75216]:   </cpu>
Nov 02 04:46:41 user nova-compute[75216]:   <devices>
Nov 02 04:46:41 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:46:41 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:46:41 user nova-compute[75216]:       <source dev="/dev/sdf"/>
Nov 02 04:46:41 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:46:41 user nova-compute[75216]:       <serial>4aa6dbad-6e4d-4a4d-925b-023e12f174e1</serial>
Nov 02 04:46:41 user nova-compute[75216]:     </disk>
Nov 02 04:46:41 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:46:41 user nova-compute[75216]:       <mac address="fa:16:3e:9b:35:37"/>
Nov 02 04:46:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:41 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:46:41 user nova-compute[75216]:       <target dev="tap1e2b5f1c-63"/>
Nov 02 04:46:41 user nova-compute[75216]:     </interface>
Nov 02 04:46:41 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:46:41 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/console.log" append="off"/>
Nov 02 04:46:41 user nova-compute[75216]:     </serial>
Nov 02 04:46:41 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:46:41 user nova-compute[75216]:     <video>
Nov 02 04:46:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:46:41 user nova-compute[75216]:     </video>
Nov 02 04:46:41 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:46:41 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:46:41 user nova-compute[75216]:     </rng>
Nov 02 04:46:41 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:46:41 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:46:41 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:46:41 user nova-compute[75216]:     </memballoon>
Nov 02 04:46:41 user nova-compute[75216]:   </devices>
Nov 02 04:46:41 user nova-compute[75216]: </domain>
Nov 02 04:46:41 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-662356066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-662356066',id=12,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-50m6mqgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:46:04Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=43182725-9f83-4afd-a243-49d838e7d811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG os_vif [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f73270d-1b11-5e33-abad-1726990dcce8', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e2b5f1c-63, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e2b5f1c-63, col_values=(('qos', UUID('5484638e-cd8b-43ec-965b-bf922b328147')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e2b5f1c-63, col_values=(('external_ids', {'iface-id': '1e2b5f1c-63f6-4ba4-883d-c528768387a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:35:37', 'vm-uuid': '43182725-9f83-4afd-a243-49d838e7d811'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: INFO os_vif [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63')
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No VIF found with MAC fa:16:3e:9b:35:37, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-73af6105-2edf-49d2-b962-823959d3a550 req-e3e424bf-9b02-4d04-9863-181ea5466e73 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73af6105-2edf-49d2-b962-823959d3a550 req-e3e424bf-9b02-4d04-9863-181ea5466e73 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73af6105-2edf-49d2-b962-823959d3a550 req-e3e424bf-9b02-4d04-9863-181ea5466e73 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73af6105-2edf-49d2-b962-823959d3a550 req-e3e424bf-9b02-4d04-9863-181ea5466e73 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-73af6105-2edf-49d2-b962-823959d3a550 req-e3e424bf-9b02-4d04-9863-181ea5466e73 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-73af6105-2edf-49d2-b962-823959d3a550 req-e3e424bf-9b02-4d04-9863-181ea5466e73 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received unexpected event network-vif-plugged-c46e7044-1d57-4413-890f-5099026b4aa5 for instance with vm_state active and task_state None.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-vif-unplugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] No waiting events found dispatching network-vif-unplugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-vif-unplugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Acquiring lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] Lock "2bf23601-af5f-4d48-a99a-74230fb02935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] No waiting events found dispatching network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-089ffb46-8b4c-44ea-85bc-68560a3716e8 req-1c9d080d-dbf0-4c8b-8a82-71dfa627420c service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received unexpected event network-vif-plugged-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f for instance with vm_state active and task_state deleting.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-e47674b7-78ab-4ff6-ab58-6088872de90e req-2c50b41f-8790-4bbe-83da-784770f66e40 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 for instance with vm_state building and task_state spawning.
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Instance destroyed successfully.
Nov 02 04:46:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lazy-loading 'resources' on Instance uuid 2bf23601-af5f-4d48-a99a-74230fb02935 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1957199507',display_name='tempest-AttachSCSIVolumeTestJSON-server-1957199507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1957199507',id=6,image_ref='a8f135eb-1725-411b-a11b-d10614b7e55f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4aGED9Y2aGpBY3Bc1U6xN5rHWQHPReY32kFfEBLArbXg3Z9MDeCRFRZL0iNkd7EovAaQnt58rSQtfdSseDmeDgGxBRimRUs8uNZo4TEc43TTRX8TgTdS2Xx/Ho/LjyUw==',key_name='tempest-keypair-1136540460',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='672b35fe5f6c43dc95669b228d81dea0',ramdisk_id='',reservation_id='r-vhm7i1wx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a8f135eb-1725-411b-a11b-d10614b7e55f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580495815',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580495815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='489d874c60324c1b828e643f43a90beb',uuid=2bf23601-af5f-4d48-a99a-74230fb02935,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Converting VIF {"id": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "address": "fa:16:3e:f5:93:46", "network": {"id": "fddf7dce-a96d-4937-a4b5-961cae9cbec9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-725164406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672b35fe5f6c43dc95669b228d81dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f26575a-4e", "ovs_interfaceid": "8f26575a-4e2a-4198-98a9-7fc67e5cfe0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:93:46,bridge_name='br-int',has_traffic_filtering=True,id=8f26575a-4e2a-4198-98a9-7fc67e5cfe0f,network=Network(fddf7dce-a96d-4937-a4b5-961cae9cbec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f26575a-4e') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG os_vif [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:93:46,bridge_name='br-int',has_traffic_filtering=True,id=8f26575a-4e2a-4198-98a9-7fc67e5cfe0f,network=Network(fddf7dce-a96d-4937-a4b5-961cae9cbec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f26575a-4e') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f26575a-4e, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4761ad17-ada5-4a62-b339-133eac2c7cc2) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: INFO os_vif [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:93:46,bridge_name='br-int',has_traffic_filtering=True,id=8f26575a-4e2a-4198-98a9-7fc67e5cfe0f,network=Network(fddf7dce-a96d-4937-a4b5-961cae9cbec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f26575a-4e')
Nov 02 04:46:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Deleting instance files /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935_del
Nov 02 04:46:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Deletion of /opt/stack/data/nova/instances/2bf23601-af5f-4d48-a99a-74230fb02935_del complete
Nov 02 04:46:43 user nova-compute[75216]: INFO nova.compute.manager [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Took 2.80 seconds to destroy the instance on the hypervisor.
Nov 02 04:46:43 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:44 user nova-compute[75216]: WARNING nova.compute.manager [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e for instance with vm_state building and task_state spawning.
Nov 02 04:46:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:44 user nova-compute[75216]: WARNING nova.compute.manager [req-e793c245-654b-4c66-a413-8e2a6580fdba req-7fa3fbae-574d-4c0a-94b1-8b8199ae62e6 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e for instance with vm_state building and task_state spawning.
Nov 02 04:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:46:44 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Took 1.04 seconds to deallocate network for instance.
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:46:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:45 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Deleted allocations for instance 2bf23601-af5f-4d48-a99a-74230fb02935
Nov 02 04:46:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e3f3821-40ab-4e71-8398-0fd33092a8ef tempest-AttachSCSIVolumeTestJSON-580495815 tempest-AttachSCSIVolumeTestJSON-580495815-project-member] Lock "2bf23601-af5f-4d48-a99a-74230fb02935" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.525s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:46 user nova-compute[75216]: WARNING nova.compute.manager [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state building and task_state spawning.
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] [instance: 2bf23601-af5f-4d48-a99a-74230fb02935] Received event network-vif-deleted-8f26575a-4e2a-4198-98a9-7fc67e5cfe0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:46:46 user nova-compute[75216]: WARNING nova.compute.manager [req-94746b16-e80d-4ace-b4a1-6c791f1a4c81 req-b94b13da-adf6-4ce1-acd5-f40db45c5c1f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state building and task_state spawning.
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:46:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance spawned successfully.
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:46:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance spawned successfully.
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:46:46 user nova-compute[75216]: INFO nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:46:46 user nova-compute[75216]: INFO nova.compute.manager [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Took 43.43 seconds to build instance.
Nov 02 04:46:46 user nova-compute[75216]: INFO nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Took 15.05 seconds to spawn the instance on the hypervisor.
Nov 02 04:46:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6afa386c-744f-43b1-a4c2-e6be3e5bcfdd tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "43182725-9f83-4afd-a243-49d838e7d811" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.623s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:46 user nova-compute[75216]: INFO nova.compute.manager [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Took 119.47 seconds to build instance.
Nov 02 04:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c938e79-4da3-4e83-8f0d-e1737ff181e4 tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 119.565s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGbqAdCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e31123e5-1b35-4456-af70-e6b3c058dae1', 'attached_at': '', 'detached_at': '', 'volume_id': '632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'serial': '632e2d96-6fbb-4fed-a24f-a786b724f0d9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e31123e5-1b35-4456-af70-e6b3c058dae1', 'attached_at': '', 'detached_at': '', 'volume_id': '7e2e1e7a-db6e-4165-9e67-b54579d54813', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGbqAdCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:46:55 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a1042-b1b3-45ca-b8e5-3bfda9082e86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:46:55 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3829bf7-8ace-4ea2-96c6-fd5b6436ca80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9] added
Nov 02 04:46:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a25a99-fbd8-4982-829c-c310ef5b4a8c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lazy-loading 'flavor' on Instance uuid 096b87b4-307f-4bda-8ad6-f0b0925aae54 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2351e25-6d00-49e9-8479-294d9633d070]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGbqAdCz {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGbqAdCz" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2264de51-93e1-48fa-a8b1-2ed4fab2a11e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGbqAdCz'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf15aa2-3039-456c-9076-da2aa3b2d161]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b823ceb-3650-4db2-84e7-0ced94f9f330]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc1312-157b-437a-b5a6-6a903576fdda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260]
Nov 02 04:46:55 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260] successful.
Nov 02 04:46:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc19764b-f487-4f1b-b701-cb2c5e1095a3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dbb3c7-999d-423c-ba63-22d358f4e9d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:46:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:46:55 user nova-compute[75216]: INFO nova.compute.manager [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Attaching volume 05280b5b-1fdb-4662-8365-760c4f18f21b to /dev/vdb
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[703021b3-4ea8-4d54-9ec1-0c57c1d87aa9]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:46:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGbqAdCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.utils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[034bbf14-079f-4b05-bfc5-ad1af4921e09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7444ce59-bb71-4f2a-91b3-afedd0779a9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b3de50-7cbf-44c9-bdca-1ab19caba9de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5bc1a1-4200-4ed8-9a8c-a77a190b2b50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:46:56 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:46:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c239788b-d27c-4ac7-b437-f69ca83d2a6b]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.utils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updating existing volume attachment record: 9ff2dc88-0f20-442b-9858-c9c2f1b6724d {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26137396565353939', 'path': '/dev/sdi'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137396565353939', 'path': '/dev/sdi'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:46:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lazy-loading 'flavor' on Instance uuid e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:46:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:46:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 110100480 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:46:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 208666624 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 356515840 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 530579456 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:46:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Waiting for libvirt event about the detach of device tapc46e7044-1d with device alias net1 from instance 521d9190-7056-42d2-a594-d1ae11b37798 is timed out.
Nov 02 04:46:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 04:46:59 user nova-compute[75216]:   <name>instance-00000007</name>
Nov 02 04:46:59 user nova-compute[75216]:   <uuid>521d9190-7056-42d2-a594-d1ae11b37798</uuid>
Nov 02 04:46:59 user nova-compute[75216]:   <metadata>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:46:59 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:creationTime>2023-11-02 04:45:33</nova:creationTime>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 02 04:46:59 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 02 04:46:59 user nova-compute[75216]:   </nova:flavor>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:owner>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:46:59 user nova-compute[75216]:   </nova:owner>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:ports>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:46:59 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:46:59 user nova-compute[75216]:     </nova:port>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:port uuid="c46e7044-1d57-4413-890f-5099026b4aa5">
Nov 02 04:46:59 user nova-compute[75216]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Nov 02 04:46:59 user nova-compute[75216]:     </nova:port>
Nov 02 04:46:59 user nova-compute[75216]:   </nova:ports>
Nov 02 04:46:59 user nova-compute[75216]: </nova:instance>
Nov 02 04:46:59 user nova-compute[75216]:   </metadata>
Nov 02 04:46:59 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 02 04:46:59 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 04:46:59 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 02 04:46:59 user nova-compute[75216]:   <resource>
Nov 02 04:46:59 user nova-compute[75216]:     <partition>/machine</partition>
Nov 02 04:46:59 user nova-compute[75216]:   </resource>
Nov 02 04:46:59 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 02 04:46:59 user nova-compute[75216]:     <system>
Nov 02 04:46:59 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 04:46:59 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 04:46:59 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 02 04:46:59 user nova-compute[75216]:       <entry name='serial'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:46:59 user nova-compute[75216]:       <entry name='uuid'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:46:59 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 02 04:46:59 user nova-compute[75216]:     </system>
Nov 02 04:46:59 user nova-compute[75216]:   </sysinfo>
Nov 02 04:46:59 user nova-compute[75216]:   <os>
Nov 02 04:46:59 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 04:46:59 user nova-compute[75216]:     <boot dev='hd'/>
Nov 02 04:46:59 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 02 04:46:59 user nova-compute[75216]:   </os>
Nov 02 04:46:59 user nova-compute[75216]:   <features>
Nov 02 04:46:59 user nova-compute[75216]:     <acpi/>
Nov 02 04:46:59 user nova-compute[75216]:     <apic/>
Nov 02 04:46:59 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 02 04:46:59 user nova-compute[75216]:   </features>
Nov 02 04:46:59 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 04:46:59 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 02 04:46:59 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 04:46:59 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 02 04:46:59 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 02 04:46:59 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 02 04:46:59 user nova-compute[75216]:   </cpu>
Nov 02 04:46:59 user nova-compute[75216]:   <clock offset='utc'>
Nov 02 04:46:59 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 04:46:59 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 04:46:59 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 02 04:46:59 user nova-compute[75216]:   </clock>
Nov 02 04:46:59 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 02 04:46:59 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 02 04:46:59 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 02 04:46:59 user nova-compute[75216]:   <devices>
Nov 02 04:46:59 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 04:46:59 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 02 04:46:59 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 04:46:59 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk' index='2'/>
Nov 02 04:46:59 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 02 04:46:59 user nova-compute[75216]:         <format type='raw'/>
Nov 02 04:46:59 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec'/>
Nov 02 04:46:59 user nova-compute[75216]:         <backingStore/>
Nov 02 04:46:59 user nova-compute[75216]:       </backingStore>
Nov 02 04:46:59 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 02 04:46:59 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </disk>
Nov 02 04:46:59 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 02 04:46:59 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 04:46:59 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config' index='1'/>
Nov 02 04:46:59 user nova-compute[75216]:       <backingStore/>
Nov 02 04:46:59 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 02 04:46:59 user nova-compute[75216]:       <readonly/>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 02 04:46:59 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </disk>
Nov 02 04:46:59 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='usb'/>
Nov 02 04:46:59 user nova-compute[75216]:     </controller>
Nov 02 04:46:59 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </controller>
Nov 02 04:46:59 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='ide'/>
Nov 02 04:46:59 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 04:46:59 user nova-compute[75216]:     </controller>
Nov 02 04:46:59 user nova-compute[75216]:     <interface type='ethernet'>
Nov 02 04:46:59 user nova-compute[75216]:       <mac address='fa:16:3e:a1:68:27'/>
Nov 02 04:46:59 user nova-compute[75216]:       <target dev='tap9df687c6-2d'/>
Nov 02 04:46:59 user nova-compute[75216]:       <model type='virtio'/>
Nov 02 04:46:59 user nova-compute[75216]:       <mtu size='1442'/>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='net0'/>
Nov 02 04:46:59 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </interface>
Nov 02 04:46:59 user nova-compute[75216]:     <serial type='pty'>
Nov 02 04:46:59 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:46:59 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:46:59 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 02 04:46:59 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 02 04:46:59 user nova-compute[75216]:       </target>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </serial>
Nov 02 04:46:59 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 04:46:59 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:46:59 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:46:59 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </console>
Nov 02 04:46:59 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='input0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </input>
Nov 02 04:46:59 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='input1'/>
Nov 02 04:46:59 user nova-compute[75216]:     </input>
Nov 02 04:46:59 user nova-compute[75216]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 04:46:59 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </graphics>
Nov 02 04:46:59 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 02 04:46:59 user nova-compute[75216]:     <video>
Nov 02 04:46:59 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='video0'/>
Nov 02 04:46:59 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </video>
Nov 02 04:46:59 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 02 04:46:59 user nova-compute[75216]:       <stats period='10'/>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 02 04:46:59 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </memballoon>
Nov 02 04:46:59 user nova-compute[75216]:     <rng model='virtio'>
Nov 02 04:46:59 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 02 04:46:59 user nova-compute[75216]:       <alias name='rng0'/>
Nov 02 04:46:59 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 04:46:59 user nova-compute[75216]:     </rng>
Nov 02 04:46:59 user nova-compute[75216]:   </devices>
Nov 02 04:46:59 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 04:46:59 user nova-compute[75216]:     <label>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</label>
Nov 02 04:46:59 user nova-compute[75216]:     <imagelabel>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</imagelabel>
Nov 02 04:46:59 user nova-compute[75216]:   </seclabel>
Nov 02 04:46:59 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 04:46:59 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 02 04:46:59 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 04:46:59 user nova-compute[75216]:   </seclabel>
Nov 02 04:46:59 user nova-compute[75216]: </domain>
Nov 02 04:46:59 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 04:46:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully detached device tapc46e7044-1d from instance 521d9190-7056-42d2-a594-d1ae11b37798 from the live domain config.
Nov 02 04:46:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converting VIF {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG os_vif [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc46e7044-1d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d107ebd-82ce-4931-80bb-f80176d39583) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:46:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:46:59 user nova-compute[75216]: INFO os_vif [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d')
Nov 02 04:46:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:46:59 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:creationTime>2023-11-02 04:46:59</nova:creationTime>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 02 04:46:59 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 02 04:46:59 user nova-compute[75216]:   </nova:flavor>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:owner>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:46:59 user nova-compute[75216]:   </nova:owner>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:46:59 user nova-compute[75216]:   <nova:ports>
Nov 02 04:46:59 user nova-compute[75216]:     <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:46:59 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:46:59 user nova-compute[75216]:     </nova:port>
Nov 02 04:46:59 user nova-compute[75216]:   </nova:ports>
Nov 02 04:46:59 user nova-compute[75216]: </nova:instance>
Nov 02 04:46:59 user nova-compute[75216]:  {{(pid=75216) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 703594496 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 845152256 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-deleted-c46e7044-1d57-4413-890f-5099026b4aa5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:00 user nova-compute[75216]: INFO nova.compute.manager [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Neutron deleted interface c46e7044-1d57-4413-890f-5099026b4aa5; detaching it from the instance and deleting it from the info cache
Nov 02 04:47:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquired lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG nova.objects.instance [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Lazy-loading 'system_metadata' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:00 user nova-compute[75216]: DEBUG nova.objects.instance [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Lazy-loading 'flavor' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.objects.base [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Object Instance<521d9190-7056-42d2-a594-d1ae11b37798> lazy-loaded attributes: system_metadata,flavor {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Converting VIF {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 04:47:01 user nova-compute[75216]:   <name>instance-00000007</name>
Nov 02 04:47:01 user nova-compute[75216]:   <uuid>521d9190-7056-42d2-a594-d1ae11b37798</uuid>
Nov 02 04:47:01 user nova-compute[75216]:   <metadata>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:47:01 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:creationTime>2023-11-02 04:46:59</nova:creationTime>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 02 04:47:01 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:flavor>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:owner>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:owner>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:ports>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:47:01 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:47:01 user nova-compute[75216]:     </nova:port>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:ports>
Nov 02 04:47:01 user nova-compute[75216]: </nova:instance>
Nov 02 04:47:01 user nova-compute[75216]:   </metadata>
Nov 02 04:47:01 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 02 04:47:01 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 04:47:01 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 02 04:47:01 user nova-compute[75216]:   <resource>
Nov 02 04:47:01 user nova-compute[75216]:     <partition>/machine</partition>
Nov 02 04:47:01 user nova-compute[75216]:   </resource>
Nov 02 04:47:01 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 02 04:47:01 user nova-compute[75216]:     <system>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='serial'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='uuid'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 02 04:47:01 user nova-compute[75216]:     </system>
Nov 02 04:47:01 user nova-compute[75216]:   </sysinfo>
Nov 02 04:47:01 user nova-compute[75216]:   <os>
Nov 02 04:47:01 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 04:47:01 user nova-compute[75216]:     <boot dev='hd'/>
Nov 02 04:47:01 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 02 04:47:01 user nova-compute[75216]:   </os>
Nov 02 04:47:01 user nova-compute[75216]:   <features>
Nov 02 04:47:01 user nova-compute[75216]:     <acpi/>
Nov 02 04:47:01 user nova-compute[75216]:     <apic/>
Nov 02 04:47:01 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 02 04:47:01 user nova-compute[75216]:   </features>
Nov 02 04:47:01 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 04:47:01 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 02 04:47:01 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 04:47:01 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 02 04:47:01 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 02 04:47:01 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 02 04:47:01 user nova-compute[75216]:   </cpu>
Nov 02 04:47:01 user nova-compute[75216]:   <clock offset='utc'>
Nov 02 04:47:01 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 04:47:01 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 04:47:01 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 02 04:47:01 user nova-compute[75216]:   </clock>
Nov 02 04:47:01 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 02 04:47:01 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 02 04:47:01 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 02 04:47:01 user nova-compute[75216]:   <devices>
Nov 02 04:47:01 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 04:47:01 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 02 04:47:01 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 04:47:01 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk' index='2'/>
Nov 02 04:47:01 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 02 04:47:01 user nova-compute[75216]:         <format type='raw'/>
Nov 02 04:47:01 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec'/>
Nov 02 04:47:01 user nova-compute[75216]:         <backingStore/>
Nov 02 04:47:01 user nova-compute[75216]:       </backingStore>
Nov 02 04:47:01 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </disk>
Nov 02 04:47:01 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 02 04:47:01 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 04:47:01 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config' index='1'/>
Nov 02 04:47:01 user nova-compute[75216]:       <backingStore/>
Nov 02 04:47:01 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 02 04:47:01 user nova-compute[75216]:       <readonly/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </disk>
Nov 02 04:47:01 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='usb'/>
Nov 02 04:47:01 user nova-compute[75216]:     </controller>
Nov 02 04:47:01 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </controller>
Nov 02 04:47:01 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='ide'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 04:47:01 user nova-compute[75216]:     </controller>
Nov 02 04:47:01 user nova-compute[75216]:     <interface type='ethernet'>
Nov 02 04:47:01 user nova-compute[75216]:       <mac address='fa:16:3e:a1:68:27'/>
Nov 02 04:47:01 user nova-compute[75216]:       <target dev='tap9df687c6-2d'/>
Nov 02 04:47:01 user nova-compute[75216]:       <model type='virtio'/>
Nov 02 04:47:01 user nova-compute[75216]:       <mtu size='1442'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='net0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </interface>
Nov 02 04:47:01 user nova-compute[75216]:     <serial type='pty'>
Nov 02 04:47:01 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:47:01 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:47:01 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 02 04:47:01 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 02 04:47:01 user nova-compute[75216]:       </target>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </serial>
Nov 02 04:47:01 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 04:47:01 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:47:01 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:47:01 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </console>
Nov 02 04:47:01 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='input0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </input>
Nov 02 04:47:01 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='input1'/>
Nov 02 04:47:01 user nova-compute[75216]:     </input>
Nov 02 04:47:01 user nova-compute[75216]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 04:47:01 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </graphics>
Nov 02 04:47:01 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 02 04:47:01 user nova-compute[75216]:     <video>
Nov 02 04:47:01 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='video0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </video>
Nov 02 04:47:01 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 02 04:47:01 user nova-compute[75216]:       <stats period='10'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </memballoon>
Nov 02 04:47:01 user nova-compute[75216]:     <rng model='virtio'>
Nov 02 04:47:01 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='rng0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </rng>
Nov 02 04:47:01 user nova-compute[75216]:   </devices>
Nov 02 04:47:01 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 04:47:01 user nova-compute[75216]:     <label>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</label>
Nov 02 04:47:01 user nova-compute[75216]:     <imagelabel>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</imagelabel>
Nov 02 04:47:01 user nova-compute[75216]:   </seclabel>
Nov 02 04:47:01 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 04:47:01 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 02 04:47:01 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 04:47:01 user nova-compute[75216]:   </seclabel>
Nov 02 04:47:01 user nova-compute[75216]: </domain>
Nov 02 04:47:01 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:57:07"/><model type="virtio"/><mtu size="1442"/><target dev="tapc46e7044-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 04:47:01 user nova-compute[75216]:   <name>instance-00000007</name>
Nov 02 04:47:01 user nova-compute[75216]:   <uuid>521d9190-7056-42d2-a594-d1ae11b37798</uuid>
Nov 02 04:47:01 user nova-compute[75216]:   <metadata>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:47:01 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:creationTime>2023-11-02 04:46:59</nova:creationTime>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 02 04:47:01 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:flavor>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:owner>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:owner>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:ports>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:47:01 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:47:01 user nova-compute[75216]:     </nova:port>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:ports>
Nov 02 04:47:01 user nova-compute[75216]: </nova:instance>
Nov 02 04:47:01 user nova-compute[75216]:   </metadata>
Nov 02 04:47:01 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 02 04:47:01 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 04:47:01 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 02 04:47:01 user nova-compute[75216]:   <resource>
Nov 02 04:47:01 user nova-compute[75216]:     <partition>/machine</partition>
Nov 02 04:47:01 user nova-compute[75216]:   </resource>
Nov 02 04:47:01 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 02 04:47:01 user nova-compute[75216]:     <system>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='serial'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='uuid'>521d9190-7056-42d2-a594-d1ae11b37798</entry>
Nov 02 04:47:01 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 02 04:47:01 user nova-compute[75216]:     </system>
Nov 02 04:47:01 user nova-compute[75216]:   </sysinfo>
Nov 02 04:47:01 user nova-compute[75216]:   <os>
Nov 02 04:47:01 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 04:47:01 user nova-compute[75216]:     <boot dev='hd'/>
Nov 02 04:47:01 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 02 04:47:01 user nova-compute[75216]:   </os>
Nov 02 04:47:01 user nova-compute[75216]:   <features>
Nov 02 04:47:01 user nova-compute[75216]:     <acpi/>
Nov 02 04:47:01 user nova-compute[75216]:     <apic/>
Nov 02 04:47:01 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 02 04:47:01 user nova-compute[75216]:   </features>
Nov 02 04:47:01 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 04:47:01 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 02 04:47:01 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 04:47:01 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 02 04:47:01 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 02 04:47:01 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 02 04:47:01 user nova-compute[75216]:   </cpu>
Nov 02 04:47:01 user nova-compute[75216]:   <clock offset='utc'>
Nov 02 04:47:01 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 04:47:01 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 04:47:01 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 02 04:47:01 user nova-compute[75216]:   </clock>
Nov 02 04:47:01 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 02 04:47:01 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 02 04:47:01 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 02 04:47:01 user nova-compute[75216]:   <devices>
Nov 02 04:47:01 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 04:47:01 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 02 04:47:01 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 04:47:01 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk' index='2'/>
Nov 02 04:47:01 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 02 04:47:01 user nova-compute[75216]:         <format type='raw'/>
Nov 02 04:47:01 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec'/>
Nov 02 04:47:01 user nova-compute[75216]:         <backingStore/>
Nov 02 04:47:01 user nova-compute[75216]:       </backingStore>
Nov 02 04:47:01 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </disk>
Nov 02 04:47:01 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 02 04:47:01 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 04:47:01 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk.config' index='1'/>
Nov 02 04:47:01 user nova-compute[75216]:       <backingStore/>
Nov 02 04:47:01 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 02 04:47:01 user nova-compute[75216]:       <readonly/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </disk>
Nov 02 04:47:01 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='usb'/>
Nov 02 04:47:01 user nova-compute[75216]:     </controller>
Nov 02 04:47:01 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </controller>
Nov 02 04:47:01 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='ide'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 04:47:01 user nova-compute[75216]:     </controller>
Nov 02 04:47:01 user nova-compute[75216]:     <interface type='ethernet'>
Nov 02 04:47:01 user nova-compute[75216]:       <mac address='fa:16:3e:a1:68:27'/>
Nov 02 04:47:01 user nova-compute[75216]:       <target dev='tap9df687c6-2d'/>
Nov 02 04:47:01 user nova-compute[75216]:       <model type='virtio'/>
Nov 02 04:47:01 user nova-compute[75216]:       <mtu size='1442'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='net0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </interface>
Nov 02 04:47:01 user nova-compute[75216]:     <serial type='pty'>
Nov 02 04:47:01 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:47:01 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:47:01 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 02 04:47:01 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 02 04:47:01 user nova-compute[75216]:       </target>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </serial>
Nov 02 04:47:01 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 04:47:01 user nova-compute[75216]:       <source path='/dev/pts/6'/>
Nov 02 04:47:01 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/console.log' append='off'/>
Nov 02 04:47:01 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='serial0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </console>
Nov 02 04:47:01 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='input0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </input>
Nov 02 04:47:01 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='input1'/>
Nov 02 04:47:01 user nova-compute[75216]:     </input>
Nov 02 04:47:01 user nova-compute[75216]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 04:47:01 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </graphics>
Nov 02 04:47:01 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 02 04:47:01 user nova-compute[75216]:     <video>
Nov 02 04:47:01 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='video0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </video>
Nov 02 04:47:01 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 02 04:47:01 user nova-compute[75216]:       <stats period='10'/>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </memballoon>
Nov 02 04:47:01 user nova-compute[75216]:     <rng model='virtio'>
Nov 02 04:47:01 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 02 04:47:01 user nova-compute[75216]:       <alias name='rng0'/>
Nov 02 04:47:01 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 04:47:01 user nova-compute[75216]:     </rng>
Nov 02 04:47:01 user nova-compute[75216]:   </devices>
Nov 02 04:47:01 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 04:47:01 user nova-compute[75216]:     <label>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</label>
Nov 02 04:47:01 user nova-compute[75216]:     <imagelabel>libvirt-521d9190-7056-42d2-a594-d1ae11b37798</imagelabel>
Nov 02 04:47:01 user nova-compute[75216]:   </seclabel>
Nov 02 04:47:01 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 04:47:01 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 02 04:47:01 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 04:47:01 user nova-compute[75216]:   </seclabel>
Nov 02 04:47:01 user nova-compute[75216]: </domain>
Nov 02 04:47:01 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 04:47:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Detaching interface fa:16:3e:f0:57:07 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapc46e7044-1d' not found.
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Converting VIF {"id": "c46e7044-1d57-4413-890f-5099026b4aa5", "address": "fa:16:3e:f0:57:07", "network": {"id": "8141c6ab-b069-4d75-a065-18b182b16644", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159259565", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46e7044-1d", "ovs_interfaceid": "c46e7044-1d57-4413-890f-5099026b4aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_vif [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 978321408 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc46e7044-1d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:47:01 user nova-compute[75216]: INFO os_vif [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:57:07,bridge_name='br-int',has_traffic_filtering=True,id=c46e7044-1d57-4413-890f-5099026b4aa5,network=Network(8141c6ab-b069-4d75-a065-18b182b16644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46e7044-1d')
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-47279ea8-463c-48ae-9842-02d9891195fd req-4bedb398-3119-4263-b915-4b346e9f58a7 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:47:01 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-2010071067</nova:name>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:creationTime>2023-11-02 04:47:01</nova:creationTime>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 02 04:47:01 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:flavor>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:owner>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:user uuid="0544ce72c149454ebea470afdebf777a">tempest-TaggedAttachmentsTest-1994857893-project-member</nova:user>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:project uuid="7db9bb5dbed54b22b9144e4fc46e2195">tempest-TaggedAttachmentsTest-1994857893</nova:project>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:owner>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:47:01 user nova-compute[75216]:   <nova:ports>
Nov 02 04:47:01 user nova-compute[75216]:     <nova:port uuid="9df687c6-2d85-4a7f-9afc-be274cd71afd">
Nov 02 04:47:01 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:47:01 user nova-compute[75216]:     </nova:port>
Nov 02 04:47:01 user nova-compute[75216]:   </nova:ports>
Nov 02 04:47:01 user nova-compute[75216]: </nova:instance>
Nov 02 04:47:01 user nova-compute[75216]:  {{(pid=75216) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [{"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Releasing lock "refresh_cache-521d9190-7056-42d2-a594-d1ae11b37798" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3e2de65-50f8-4ea4-b15e-5e76693dabe9 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "interface-521d9190-7056-42d2-a594-d1ae11b37798-c46e7044-1d57-4413-890f-5099026b4aa5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.470s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:47:01 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c72608-0282-4fc9-a0f2-0643051fb45e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:47:01 user nova-compute[75216]: No targets found.
Nov 02 04:47:01 user nova-compute[75216]: iSNS:
Nov 02 04:47:01 user nova-compute[75216]: No targets found.
Nov 02 04:47:01 user nova-compute[75216]: STATIC:
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4
Nov 02 04:47:01 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:01 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:01 user nova-compute[75216]: FIRMWARE:
Nov 02 04:47:01 user nova-compute[75216]: No targets found.
Nov 02 04:47:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:47:01 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:47:01 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54045bde-c23d-40d2-88fa-62e81dfe9150]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388549a-170b-4023-84b6-441b49b80ca6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460c35fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813'): ({'sdg'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Removing single pathed devices sdg {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84fb1eb-887f-430d-9b77-03b0b2fe0581]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f149fb5-73c3-4552-bdb3-b4bdff6744e9]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Flushing IO for device /dev/sdg {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e23248-a658-470f-ac77-b895466b4b15]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3f0ce5-4c39-47d3-88a5-5b73437bbcda]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7b7edd-bc62-4d0f-a16f-986414e69ca0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[660a88a8-5fe7-474b-b8ae-e072dee4b257]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]
Nov 02 04:47:02 user nova-compute[75216]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.
Nov 02 04:47:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958ff04-d91c-441f-8a4b-ce97b9a32eae]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] <== disconnect_volume: return (402ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGbqAdCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'e31123e5-1b35-4456-af70-e6b3c058dae1', 'attached_at': '', 'detached_at': '', 'volume_id': '632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] swap_volume: removing Cinder connection for volume 7e2e1e7a-db6e-4165-9e67-b54579d54813 {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:06 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:06 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7768MB free_disk=25.25844955444336GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 521d9190-7056-42d2-a594-d1ae11b37798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance faf3ef57-71fb-4ba2-a817-497c40f649a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e31123e5-1b35-4456-af70-e6b3c058dae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 075b3db8-71aa-4bd7-8c7a-8cc5835594de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1790f117-7ae5-4b92-8c68-13d8da9f18ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:47:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:47:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:47:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:47:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:47:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:47:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:47:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:47:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updating instance_info_cache with network_info: [{"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-a2b40b8c-5b97-4bf8-adad-647ff27e2bab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] swap_volume: Updating volume 7e2e1e7a-db6e-4165-9e67-b54579d54813 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vGbqAdCz", "auth_password": "gQTK5Yh2kzBGe1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "632e2d96-6fbb-4fed-a24f-a786b724f0d9"}, "status": "reserved", "instance": "e31123e5-1b35-4456-af70-e6b3c058dae1", "attached_at": "", "detached_at": "", "volume_id": "632e2d96-6fbb-4fed-a24f-a786b724f0d9", "serial": "632e2d96-6fbb-4fed-a24f-a786b724f0d9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'no_device': None, 'attachment_id': '8053f20e-bcec-4009-8d83-3112de2217d5'} {{(pid=75216) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Nov 02 04:47:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c71d6f94-655d-4816-8c4d-ab659f0b1d12 tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 50.600s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6971ca36-1d42-4341-88b4-14be023fa922]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e1683-105d-4e52-95f9-33f3d59de787]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1435dd-9dbd-4c85-9c34-a59362a24f33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f38f43-fced-4aae-b72e-45d58986d5bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:47:11 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:47:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d38a9df-3a01-4c31-bd08-be89131202fc]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:47:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:47:11 user nova-compute[75216]: INFO nova.compute.manager [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Swapping volume 632e2d96-6fbb-4fed-a24f-a786b724f0d9 for 7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:47:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.volume.cinder [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Update attachment failed for attachment 9ff2dc88-0f20-442b-9858-c9c2f1b6724d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-60fd5248-1f2a-4233-87b1-d4ac07f273b4) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-60fd5248-1f2a-4233-87b1-d4ac07f273b4)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Failed to attach 05280b5b-1fdb-4662-8365-760c4f18f21b at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-60fd5248-1f2a-4233-87b1-d4ac07f273b4)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Traceback (most recent call last):
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     self._do_attach(context, instance, volume, volume_api,
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     self._volume_attach(context, volume, connector, instance,
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     connection_info = volume_api.attachment_update(
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     res = method(self, ctx, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     with excutils.save_and_reraise_exception():
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     self.force_reraise()
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     raise self.value
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     return method.func(obj, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     resp = self._update('/attachments/%s' % id, body)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     return self.request(url, method, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54]     raise exceptions.from_response(resp, body)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-60fd5248-1f2a-4233-87b1-d4ac07f273b4)
Nov 02 04:47:18 user nova-compute[75216]: ERROR nova.compute.manager [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] 
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.580s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server [None req-d1a8698d-f2f8-4457-a375-5275a5569309 tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-60fd5248-1f2a-4233-87b1-d4ac07f273b4)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-60fd5248-1f2a-4233-87b1-d4ac07f273b4)
Nov 02 04:47:18 user nova-compute[75216]: ERROR oslo_messaging.rpc.server 
Nov 02 04:47:18 user nova-compute[75216]: INFO nova.compute.manager [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Terminating instance
Nov 02 04:47:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-f56ed687-7263-41a5-9eb0-6b877a9e3d93 req-35305a48-fb0c-4768-9fdf-7822b36d5852 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-vif-unplugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f56ed687-7263-41a5-9eb0-6b877a9e3d93 req-35305a48-fb0c-4768-9fdf-7822b36d5852 service nova] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f56ed687-7263-41a5-9eb0-6b877a9e3d93 req-35305a48-fb0c-4768-9fdf-7822b36d5852 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f56ed687-7263-41a5-9eb0-6b877a9e3d93 req-35305a48-fb0c-4768-9fdf-7822b36d5852 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-f56ed687-7263-41a5-9eb0-6b877a9e3d93 req-35305a48-fb0c-4768-9fdf-7822b36d5852 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] No waiting events found dispatching network-vif-unplugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-f56ed687-7263-41a5-9eb0-6b877a9e3d93 req-35305a48-fb0c-4768-9fdf-7822b36d5852 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-vif-unplugged-04233350-adb4-44b1-9121-0ec06fd9b577 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:47:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Instance destroyed successfully.
Nov 02 04:47:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lazy-loading 'resources' on Instance uuid faf3ef57-71fb-4ba2-a817-497c40f649a0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-810450363',display_name='tempest-VolumesAssistedSnapshotsTest-server-810450363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-810450363',id=8,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1v55wJRuxakxzr5eZE7vGNaEBQQvAYs8IQxrL3v37z8TwB99o6LQGoRZP48nOp0r3FhyckvuVX0PmFa1HPds95yzVlJzHUpvj8cIRt9axbt/igX+XbZrx6t6vac7IChg==',key_name='tempest-keypair-1067127104',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc748dbc75f04202b94f1d25c4e79f98',ramdisk_id='',reservation_id='r-ogcfm652',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1716857785',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1716857785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59d9304af0ca46b9beb5132cbe5c0ce9',uuid=faf3ef57-71fb-4ba2-a817-497c40f649a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Converting VIF {"id": "04233350-adb4-44b1-9121-0ec06fd9b577", "address": "fa:16:3e:4d:5d:bb", "network": {"id": "9e63955d-b28f-4b0e-a0de-087239533469", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1591871222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc748dbc75f04202b94f1d25c4e79f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04233350-ad", "ovs_interfaceid": "04233350-adb4-44b1-9121-0ec06fd9b577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=04233350-adb4-44b1-9121-0ec06fd9b577,network=Network(9e63955d-b28f-4b0e-a0de-087239533469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04233350-ad') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG os_vif [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=04233350-adb4-44b1-9121-0ec06fd9b577,network=Network(9e63955d-b28f-4b0e-a0de-087239533469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04233350-ad') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04233350-ad, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f8a6ed1-564a-4fd3-b509-2cd10f99f4f4) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:19 user nova-compute[75216]: INFO os_vif [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:5d:bb,bridge_name='br-int',has_traffic_filtering=True,id=04233350-adb4-44b1-9121-0ec06fd9b577,network=Network(9e63955d-b28f-4b0e-a0de-087239533469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04233350-ad')
Nov 02 04:47:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Deleting instance files /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0_del
Nov 02 04:47:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Deletion of /opt/stack/data/nova/instances/faf3ef57-71fb-4ba2-a817-497c40f649a0_del complete
Nov 02 04:47:19 user nova-compute[75216]: INFO nova.compute.manager [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 02 04:47:19 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:47:19 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:20 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Took 0.67 seconds to deallocate network for instance.
Nov 02 04:47:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-b29ca288-87dc-41d9-90d0-d5c15cdec554 req-d292df7f-1538-46c8-96d6-18a03186cca2 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-vif-deleted-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:20 user nova-compute[75216]: INFO nova.compute.manager [req-b29ca288-87dc-41d9-90d0-d5c15cdec554 req-d292df7f-1538-46c8-96d6-18a03186cca2 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Neutron deleted interface 04233350-adb4-44b1-9121-0ec06fd9b577; detaching it from the instance and deleting it from the info cache
Nov 02 04:47:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-b29ca288-87dc-41d9-90d0-d5c15cdec554 req-d292df7f-1538-46c8-96d6-18a03186cca2 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-b29ca288-87dc-41d9-90d0-d5c15cdec554 req-d292df7f-1538-46c8-96d6-18a03186cca2 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Detach interface failed, port_id=04233350-adb4-44b1-9121-0ec06fd9b577, reason: Instance faf3ef57-71fb-4ba2-a817-497c40f649a0 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:20 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Deleted allocations for instance faf3ef57-71fb-4ba2-a817-497c40f649a0
Nov 02 04:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcedff60-14a9-4e2d-bbae-ef6f8f154f8f tempest-VolumesAssistedSnapshotsTest-1716857785 tempest-VolumesAssistedSnapshotsTest-1716857785-project-member] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-c701252e-6f77-46ef-88b3-bf1a8f557e9e req-122ce20a-02c1-4756-8461-f403c2f82cb8 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received event network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c701252e-6f77-46ef-88b3-bf1a8f557e9e req-122ce20a-02c1-4756-8461-f403c2f82cb8 service nova] Acquiring lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c701252e-6f77-46ef-88b3-bf1a8f557e9e req-122ce20a-02c1-4756-8461-f403c2f82cb8 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c701252e-6f77-46ef-88b3-bf1a8f557e9e req-122ce20a-02c1-4756-8461-f403c2f82cb8 service nova] Lock "faf3ef57-71fb-4ba2-a817-497c40f649a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-c701252e-6f77-46ef-88b3-bf1a8f557e9e req-122ce20a-02c1-4756-8461-f403c2f82cb8 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] No waiting events found dispatching network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:21 user nova-compute[75216]: WARNING nova.compute.manager [req-c701252e-6f77-46ef-88b3-bf1a8f557e9e req-122ce20a-02c1-4756-8461-f403c2f82cb8 service nova] [instance: faf3ef57-71fb-4ba2-a817-497c40f649a0] Received unexpected event network-vif-plugged-04233350-adb4-44b1-9121-0ec06fd9b577 for instance with vm_state deleted and task_state None.
Nov 02 04:47:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:47:28 user nova-compute[75216]: INFO nova.compute.claims [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Claim successful on node user
Nov 02 04:47:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:47:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:47:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:47:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:47:29 user nova-compute[75216]: INFO nova.virt.block_device [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Booting with volume 8df56c1c-21c1-475a-90de-70a2e7a7c948 at /dev/vda
Nov 02 04:47:29 user nova-compute[75216]: DEBUG nova.policy [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d62e71597ef4d2fac3eb798fac76357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3feded7f0e024aa2b09aa6a76f73f0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG os_brick.utils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa47dc-67a8-4b33-9836-8b0cca73a1f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0605e85f-e914-4876-98ef-94e034bdcec7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ca73c-1354-4230-a351-a994616ab04c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0006b24f-59bc-45c6-b441-f88cb2394ddd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:47:29 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705b18e-a6bf-407d-b214-11c1e1c2320c]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG os_brick.utils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updating existing volume attachment record: fda2311b-d251-405f-9ccd-974d039fa272 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Successfully created port: 737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:30 user nova-compute[75216]: INFO nova.compute.manager [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Terminating instance
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-5e3d3f12-9e05-4e80-bb21-fe56754c4b88 req-995da18b-c2c4-46e4-9b12-febb7ec21ef8 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-unplugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5e3d3f12-9e05-4e80-bb21-fe56754c4b88 req-995da18b-c2c4-46e4-9b12-febb7ec21ef8 service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5e3d3f12-9e05-4e80-bb21-fe56754c4b88 req-995da18b-c2c4-46e4-9b12-febb7ec21ef8 service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5e3d3f12-9e05-4e80-bb21-fe56754c4b88 req-995da18b-c2c4-46e4-9b12-febb7ec21ef8 service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-5e3d3f12-9e05-4e80-bb21-fe56754c4b88 req-995da18b-c2c4-46e4-9b12-febb7ec21ef8 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-unplugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-5e3d3f12-9e05-4e80-bb21-fe56754c4b88 req-995da18b-c2c4-46e4-9b12-febb7ec21ef8 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-unplugged-9df687c6-2d85-4a7f-9afc-be274cd71afd for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Successfully updated port: 737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquired lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-changed-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Refreshing instance network info cache due to event network-changed-737e2805-edf4-49cd-997e-f93852c268d1. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] Acquiring lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updating instance_info_cache with network_info: [{"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Releasing lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance network_info: |[{"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] Acquired lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Refreshing network info cache for port 737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:47:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Instance destroyed successfully.
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lazy-loading 'resources' on Instance uuid 521d9190-7056-42d2-a594-d1ae11b37798 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2010071067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2010071067',id=7,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy3jl8MbiKQBompKTzbZfaoSXQi5NPjhNf0tTMiU+QDMp9cL0AnaDgmRRFBbu3yffJ30m1yR+l0l3vd1Gv/aAIywNUDV0Y29nkLDvrjfTG4DR0eNq4b8ddu20ptcTq7WQ==',key_name='tempest-keypair-1328303289',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7db9bb5dbed54b22b9144e4fc46e2195',ramdisk_id='',reservation_id='r-b982fe0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1994857893',owner_user_name='tempest-TaggedAttachmentsTest-1994857893-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0544ce72c149454ebea470afdebf777a',uuid=521d9190-7056-42d2-a594-d1ae11b37798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converting VIF {"id": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "address": "fa:16:3e:a1:68:27", "network": {"id": "b38fcf0a-e4ec-421d-b58a-99ea86f79f79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-898616146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7db9bb5dbed54b22b9144e4fc46e2195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df687c6-2d", "ovs_interfaceid": "9df687c6-2d85-4a7f-9afc-be274cd71afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:68:27,bridge_name='br-int',has_traffic_filtering=True,id=9df687c6-2d85-4a7f-9afc-be274cd71afd,network=Network(b38fcf0a-e4ec-421d-b58a-99ea86f79f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df687c6-2d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG os_vif [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:68:27,bridge_name='br-int',has_traffic_filtering=True,id=9df687c6-2d85-4a7f-9afc-be274cd71afd,network=Network(b38fcf0a-e4ec-421d-b58a-99ea86f79f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df687c6-2d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9df687c6-2d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc924984-88eb-4d12-88db-04da7043d7a5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:30 user nova-compute[75216]: INFO os_vif [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:68:27,bridge_name='br-int',has_traffic_filtering=True,id=9df687c6-2d85-4a7f-9afc-be274cd71afd,network=Network(b38fcf0a-e4ec-421d-b58a-99ea86f79f79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df687c6-2d')
Nov 02 04:47:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Deleting instance files /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798_del
Nov 02 04:47:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Deletion of /opt/stack/data/nova/instances/521d9190-7056-42d2-a594-d1ae11b37798_del complete
Nov 02 04:47:31 user nova-compute[75216]: INFO nova.compute.manager [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 02 04:47:31 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:47:31 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:47:31 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:47:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updated VIF entry in instance network info cache for port 737e2805-edf4-49cd-997e-f93852c268d1. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:47:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updating instance_info_cache with network_info: [{"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1810785e-973a-433b-b7d0-7e12b9e3631a req-ee695f00-4520-4fed-aaac-906660b7a260 service nova] Releasing lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-dd341642-b0db-4026-9b94-89b678bcb732 req-712bd71a-1e3f-497b-8bbc-aa287cb4aa95 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dd341642-b0db-4026-9b94-89b678bcb732 req-712bd71a-1e3f-497b-8bbc-aa287cb4aa95 service nova] Acquiring lock "521d9190-7056-42d2-a594-d1ae11b37798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dd341642-b0db-4026-9b94-89b678bcb732 req-712bd71a-1e3f-497b-8bbc-aa287cb4aa95 service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dd341642-b0db-4026-9b94-89b678bcb732 req-712bd71a-1e3f-497b-8bbc-aa287cb4aa95 service nova] Lock "521d9190-7056-42d2-a594-d1ae11b37798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-dd341642-b0db-4026-9b94-89b678bcb732 req-712bd71a-1e3f-497b-8bbc-aa287cb4aa95 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] No waiting events found dispatching network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:32 user nova-compute[75216]: WARNING nova.compute.manager [req-dd341642-b0db-4026-9b94-89b678bcb732 req-712bd71a-1e3f-497b-8bbc-aa287cb4aa95 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received unexpected event network-vif-plugged-9df687c6-2d85-4a7f-9afc-be274cd71afd for instance with vm_state active and task_state deleting.
Nov 02 04:47:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:33 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:33 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Took 2.09 seconds to deallocate network for instance.
Nov 02 04:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-0b82bcd6-8f00-4d57-a82e-4b45c9b87a0b req-c45de5fd-5219-49cf-abc2-f83638549cf6 service nova] [instance: 521d9190-7056-42d2-a594-d1ae11b37798] Received event network-vif-deleted-9df687c6-2d85-4a7f-9afc-be274cd71afd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:33 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:47:33 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:33 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Deleted allocations for instance 521d9190-7056-42d2-a594-d1ae11b37798
Nov 02 04:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-98086f44-d096-4346-87fd-9b9634b88de0 tempest-TaggedAttachmentsTest-1994857893 tempest-TaggedAttachmentsTest-1994857893-project-member] Lock "521d9190-7056-42d2-a594-d1ae11b37798" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.700s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquired lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'info_cache' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-changed-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Refreshing instance network info cache due to event network-changed-a99d1c1b-fbac-4040-9a24-552930e830a5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] Acquiring lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] Acquired lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Refreshing network info cache for port a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:47:37 user nova-compute[75216]: DEBUG nova.objects.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:38 user nova-compute[75216]: INFO nova.compute.manager [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Terminating instance
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Updated VIF entry in instance network info cache for port a99d1c1b-fbac-4040-9a24-552930e830a5. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Updating instance_info_cache with network_info: [{"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Releasing lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9b276947-5a16-42c2-9f99-b37e232cc701 req-407a73fb-b2d5-4740-a328-f7985b7914ee service nova] Releasing lock "refresh_cache-1790f117-7ae5-4b92-8c68-13d8da9f18ff" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:47:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance destroyed successfully.
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'resources' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.objects.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_vif [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80407938-aa, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f11c6062-372f-41fb-be0b-9ad3a809833f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: INFO os_vif [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa')
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JztYWQgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:47:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d69028-646e-42ca-bbe5-caa50d32c568]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:47:38 user nova-compute[75216]: No targets found.
Nov 02 04:47:38 user nova-compute[75216]: iSNS:
Nov 02 04:47:38 user nova-compute[75216]: No targets found.
Nov 02 04:47:38 user nova-compute[75216]: STATIC:
Nov 02 04:47:38 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:47:38 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:38 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:38 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed
Nov 02 04:47:38 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:38 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:38 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9
Nov 02 04:47:38 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:38 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:38 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980
Nov 02 04:47:38 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:38 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:38 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:47:38 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:38 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:38 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:47:38 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:38 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:38 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4
Nov 02 04:47:38 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:47:38 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:47:38 user nova-compute[75216]: FIRMWARE:
Nov 02 04:47:38 user nova-compute[75216]: No targets found.
Nov 02 04:47:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:47:38 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:47:38 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f5a66d-d95a-4e85-a0f3-98e2f0d127cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf4c9cf-3dfe-444f-be50-696b9313894b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5a1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b8260a-a7cd-460d-b3dd-c4f298dea1d5]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3918c61-52bf-4b3a-8655-2af5425cd56e]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24707fbf-c042-4098-ac92-46cf49178c64]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc3033-dc76-4b27-9092-dc4b73fb0a50]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a68287d-8719-4e16-80ef-708f32d57b70]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a7ccdf-0a59-4f25-9a9d-0def161e23a4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]
Nov 02 04:47:38 user nova-compute[75216]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.
Nov 02 04:47:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2043e142-4f09-47fc-9e20-e99f6fc5d5fd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== disconnect_volume: return (392ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Start _get_guest_xml network_info=[{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'bf699209-2261-4561-b7ba-49717a5e8af8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JztYWQgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5405f6de-5da9-475e-9647-7851ca87371d', 'attached_at': '', 'detached_at': '', 'volume_id': '190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'serial': '190e3f9b-861b-4d12-a12f-e6c99f3fca12'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'numa_topology' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.objects.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Instance destroyed successfully.
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'resources' on Instance uuid 1790f117-7ae5-4b92-8c68-13d8da9f18ff {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1001261671',display_name='tempest-AttachVolumeNegativeTest-server-1001261671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1001261671',id=11,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAExkbWmle+Lth24tTiSJIgwv+fbE/VHI4MeG3Osg0jtsEdEWJPrU4IrHR/XwXIzniUy3zcV5QGZB9JveKIeiWzg475ApBKxtDvAWrATX14+CYNcmc+/Fw5YmvsqrrsuRg==',key_name='tempest-keypair-963166459',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-fpzw9269',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:45:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=1790f117-7ae5-4b92-8c68-13d8da9f18ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "a99d1c1b-fbac-4040-9a24-552930e830a5", "address": "fa:16:3e:bd:91:c4", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99d1c1b-fb", "ovs_interfaceid": "a99d1c1b-fbac-4040-9a24-552930e830a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:c4,bridge_name='br-int',has_traffic_filtering=True,id=a99d1c1b-fbac-4040-9a24-552930e830a5,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99d1c1b-fb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_vif [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:c4,bridge_name='br-int',has_traffic_filtering=True,id=a99d1c1b-fbac-4040-9a24-552930e830a5,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99d1c1b-fb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa99d1c1b-fb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9d1dd61-50bd-490c-9efc-dbf479bf7a75) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:38 user nova-compute[75216]: INFO os_vif [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:c4,bridge_name='br-int',has_traffic_filtering=True,id=a99d1c1b-fbac-4040-9a24-552930e830a5,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99d1c1b-fb')
Nov 02 04:47:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Deleting instance files /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff_del
Nov 02 04:47:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Deletion of /opt/stack/data/nova/instances/1790f117-7ae5-4b92-8c68-13d8da9f18ff_del complete
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.objects.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JztYWQgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:47:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:38 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01887f79-957a-4281-82fc-bfe354bf35c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:47:39 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e58159c-2d78-4294-b110-a510bfd6f648]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12] added
Nov 02 04:47:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: INFO nova.compute.manager [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0a5e9-6818-47ef-9b19-f3c0fea84ad4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faded6a-c873-49f0-a79d-45c76929c3ba]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JztYWQgk {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JztYWQgk" returned: 0 in 0.067s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862dbeb-b549-4eae-be34-3acf543f56f1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JztYWQgk'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ad9c0-35c2-433c-bf9f-28537aaa6ec8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[882196b9-4462-43d2-b9ca-f5f388adaf85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce32d22-94ce-462d-8dc3-e79745427eb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]
Nov 02 04:47:39 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.
Nov 02 04:47:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9ba58-393f-4dd8-add1-6f4a223a4215]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26999a65-35f3-45f8-a142-10b36a1d918f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd73f9c-dd2f-4e20-9879-708d8857ee06]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-vif-unplugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] Acquiring lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] No waiting events found dispatching network-vif-unplugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-vif-unplugged-a99d1c1b-fbac-4040-9a24-552930e830a5 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] Acquiring lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] No waiting events found dispatching network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:39 user nova-compute[75216]: WARNING nova.compute.manager [req-0cf862aa-b5f6-4905-9f9a-9c158d977d79 req-a9a20933-a19e-4f1d-a589-cd7710255be8 service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received unexpected event network-vif-plugged-a99d1c1b-fbac-4040-9a24-552930e830a5 for instance with vm_state active and task_state deleting.
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:39 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Took 0.88 seconds to deallocate network for instance.
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-ebd82373-40ac-4ac6-8619-42d7cb254491 req-21355fae-d114-4ae4-b8af-b38f16f3d6ab service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Received event network-vif-deleted-a99d1c1b-fbac-4040-9a24-552930e830a5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:39 user nova-compute[75216]: INFO nova.compute.manager [req-ebd82373-40ac-4ac6-8619-42d7cb254491 req-21355fae-d114-4ae4-b8af-b38f16f3d6ab service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Neutron deleted interface a99d1c1b-fbac-4040-9a24-552930e830a5; detaching it from the instance and deleting it from the info cache
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-ebd82373-40ac-4ac6-8619-42d7cb254491 req-21355fae-d114-4ae4-b8af-b38f16f3d6ab service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-ebd82373-40ac-4ac6-8619-42d7cb254491 req-21355fae-d114-4ae4-b8af-b38f16f3d6ab service nova] [instance: 1790f117-7ae5-4b92-8c68-13d8da9f18ff] Detach interface failed, port_id=a99d1c1b-fbac-4040-9a24-552930e830a5, reason: Instance 1790f117-7ae5-4b92-8c68-13d8da9f18ff could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:40 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Deleted allocations for instance 1790f117-7ae5-4b92-8c68-13d8da9f18ff
Nov 02 04:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JztYWQgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26136633765396164', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136633765396164', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'pci_devices' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:47:40 user nova-compute[75216]:   <uuid>5405f6de-5da9-475e-9647-7851ca87371d</uuid>
Nov 02 04:47:40 user nova-compute[75216]:   <name>instance-00000003</name>
Nov 02 04:47:40 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:47:40 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:47:40 user nova-compute[75216]:   <metadata>
Nov 02 04:47:40 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:47:40 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:47:40 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-814331073</nova:name>
Nov 02 04:47:40 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:47:38</nova:creationTime>
Nov 02 04:47:40 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:47:40 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:47:40 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:47:40 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:47:40 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:47:40 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:47:40 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:47:40 user nova-compute[75216]:       <nova:owner>
Nov 02 04:47:40 user nova-compute[75216]:         <nova:user uuid="cf5f940bafbf4fb7aa7ace530f7d10c1">tempest-AttachVolumeTestJSON-1577581979-project-member</nova:user>
Nov 02 04:47:40 user nova-compute[75216]:         <nova:project uuid="8baf55600ee343f2b8a6f94622bf9230">tempest-AttachVolumeTestJSON-1577581979</nova:project>
Nov 02 04:47:40 user nova-compute[75216]:       </nova:owner>
Nov 02 04:47:40 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:47:40 user nova-compute[75216]:       <nova:ports>
Nov 02 04:47:40 user nova-compute[75216]:         <nova:port uuid="80407938-aa15-40c0-b5a0-2100f2d9b864">
Nov 02 04:47:40 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 04:47:40 user nova-compute[75216]:         </nova:port>
Nov 02 04:47:40 user nova-compute[75216]:       </nova:ports>
Nov 02 04:47:40 user nova-compute[75216]:     </nova:instance>
Nov 02 04:47:40 user nova-compute[75216]:   </metadata>
Nov 02 04:47:40 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:47:40 user nova-compute[75216]:     <system>
Nov 02 04:47:40 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:47:40 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:47:40 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:47:40 user nova-compute[75216]:       <entry name="serial">5405f6de-5da9-475e-9647-7851ca87371d</entry>
Nov 02 04:47:40 user nova-compute[75216]:       <entry name="uuid">5405f6de-5da9-475e-9647-7851ca87371d</entry>
Nov 02 04:47:40 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:47:40 user nova-compute[75216]:     </system>
Nov 02 04:47:40 user nova-compute[75216]:   </sysinfo>
Nov 02 04:47:40 user nova-compute[75216]:   <os>
Nov 02 04:47:40 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:47:40 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:47:40 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:47:40 user nova-compute[75216]:   </os>
Nov 02 04:47:40 user nova-compute[75216]:   <features>
Nov 02 04:47:40 user nova-compute[75216]:     <acpi/>
Nov 02 04:47:40 user nova-compute[75216]:     <apic/>
Nov 02 04:47:40 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:47:40 user nova-compute[75216]:   </features>
Nov 02 04:47:40 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:47:40 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:47:40 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:47:40 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:47:40 user nova-compute[75216]:   </clock>
Nov 02 04:47:40 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:47:40 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:47:40 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:47:40 user nova-compute[75216]:   </cpu>
Nov 02 04:47:40 user nova-compute[75216]:   <devices>
Nov 02 04:47:40 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:47:40 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:47:40 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk"/>
Nov 02 04:47:40 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:47:40 user nova-compute[75216]:     </disk>
Nov 02 04:47:40 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:47:40 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:47:40 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 04:47:40 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 04:47:40 user nova-compute[75216]:       <serial>190e3f9b-861b-4d12-a12f-e6c99f3fca12</serial>
Nov 02 04:47:40 user nova-compute[75216]:     </disk>
Nov 02 04:47:40 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:47:40 user nova-compute[75216]:       <mac address="fa:16:3e:ba:61:ab"/>
Nov 02 04:47:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:47:40 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:47:40 user nova-compute[75216]:       <target dev="tap80407938-aa"/>
Nov 02 04:47:40 user nova-compute[75216]:     </interface>
Nov 02 04:47:40 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:47:40 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/console.log" append="off"/>
Nov 02 04:47:40 user nova-compute[75216]:     </serial>
Nov 02 04:47:40 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:47:40 user nova-compute[75216]:     <video>
Nov 02 04:47:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:47:40 user nova-compute[75216]:     </video>
Nov 02 04:47:40 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:47:40 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:47:40 user nova-compute[75216]:     </rng>
Nov 02 04:47:40 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:47:40 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:47:40 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:47:40 user nova-compute[75216]:     </memballoon>
Nov 02 04:47:40 user nova-compute[75216]:   </devices>
Nov 02 04:47:40 user nova-compute[75216]: </domain>
Nov 02 04:47:40 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0199cf1-10ef-4527-b3cb-3a4ec5060d13 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "1790f117-7ae5-4b92-8c68-13d8da9f18ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Cannot resize image /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'migration_context' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG nova.objects.base [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG os_vif [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '242fba5d-c742-522b-b846-973745c37886', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80407938-aa, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80407938-aa, col_values=(('qos', UUID('b3ce0d51-387e-450c-82e4-549e78ea5e0c')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80407938-aa, col_values=(('external_ids', {'iface-id': '80407938-aa15-40c0-b5a0-2100f2d9b864', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:61:ab', 'vm-uuid': '5405f6de-5da9-475e-9647-7851ca87371d'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:41 user nova-compute[75216]: INFO os_vif [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa')
Nov 02 04:47:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-70ea0553-8513-413c-a4d2-c84e21a436ef req-a15e168f-8d5f-42c3-a128-ef987668f2f7 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70ea0553-8513-413c-a4d2-c84e21a436ef req-a15e168f-8d5f-42c3-a128-ef987668f2f7 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70ea0553-8513-413c-a4d2-c84e21a436ef req-a15e168f-8d5f-42c3-a128-ef987668f2f7 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70ea0553-8513-413c-a4d2-c84e21a436ef req-a15e168f-8d5f-42c3-a128-ef987668f2f7 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-70ea0553-8513-413c-a4d2-c84e21a436ef req-a15e168f-8d5f-42c3-a128-ef987668f2f7 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:43 user nova-compute[75216]: WARNING nova.compute.manager [req-70ea0553-8513-413c-a4d2-c84e21a436ef req-a15e168f-8d5f-42c3-a128-ef987668f2f7 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state stopped and task_state powering-on.
Nov 02 04:47:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:47:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance rebooted successfully.
Nov 02 04:47:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e183f8da-302e-4e61-b67a-5f5b85c6eba4 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:47:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-127401fb-e62d-4a27-9330-ff1c968d00ba req-2011d93c-059a-4094-bd77-89d6865637ae service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-127401fb-e62d-4a27-9330-ff1c968d00ba req-2011d93c-059a-4094-bd77-89d6865637ae service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-127401fb-e62d-4a27-9330-ff1c968d00ba req-2011d93c-059a-4094-bd77-89d6865637ae service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-127401fb-e62d-4a27-9330-ff1c968d00ba req-2011d93c-059a-4094-bd77-89d6865637ae service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-127401fb-e62d-4a27-9330-ff1c968d00ba req-2011d93c-059a-4094-bd77-89d6865637ae service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:45 user nova-compute[75216]: WARNING nova.compute.manager [req-127401fb-e62d-4a27-9330-ff1c968d00ba req-2011d93c-059a-4094-bd77-89d6865637ae service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state stopped and task_state powering-on.
Nov 02 04:47:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:47:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:47:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:47:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:47:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Creating image(s)
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Ensure instance console log exists: /opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Start _get_guest_xml network_info=[{"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'fda2311b-d251-405f-9ccd-974d039fa272', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7d2e9eb-f209-4d40-ba91-5145ae5256ce', 'attached_at': '', 'detached_at': '', 'volume_id': '8df56c1c-21c1-475a-90de-70a2e7a7c948', 'serial': '8df56c1c-21c1-475a-90de-70a2e7a7c948'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:47:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:47:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:53 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b070888-085c-489a-b4b7-8343fbd174e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:47:53 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1cbd63-af0d-4922-a878-703d6c97cfcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948] added
Nov 02 04:47:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacae740-ee95-4091-88c0-531f582e1677]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1265b3b0-f6bf-425b-8639-056bb739c84c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCSBUbhu {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCSBUbhu" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de03bc3-cc4d-443b-a434-59294a4ca878]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCSBUbhu'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[857bd3b5-ac1c-453a-971c-3c3f0d046a0b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7091e22a-53aa-4dd3-b190-070e2359b2ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7bf3de-1101-44d1-a509-7b0bcede3b0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]
Nov 02 04:47:53 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.
Nov 02 04:47:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83202204-e2cf-4d96-9cd2-d3205a14bc47]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1793c38-7191-4d1a-be1f-4aafb081b515]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] HCTL ('38', '-', '-', 0) found on session 15 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4186c0-5a9f-4ad7-a24a-92c6598eadf8]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:47:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:47:54 user nova-compute[75216]: INFO nova.compute.manager [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Rescuing
Nov 02 04:47:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '26164343537656232', 'path': '/dev/sdg'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164343537656232', 'path': '/dev/sdg'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-887008941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-887008941',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikMoc+LjF47vbDkidZH2OP2JcfDYxU35Wr0fLVuf3xpHoPTwdOEtjII8qkbROyEovHT7tXE5H8ktlhKMgBrP7agimsJbCrj99IVLN7QhRVtQTlyVbrmLDd5mPkiSRl/Q==',key_name='tempest-keypair-1994893486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3feded7f0e024aa2b09aa6a76f73f0c3',ramdisk_id='',reservation_id='r-lkidyuac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1935368242',owner_user_name='tempest-ServerActionsV293TestJSON-1935368242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d62e71597ef4d2fac3eb798fac76357',uuid=e7d2e9eb-f209-4d40-ba91-5145ae5256ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converting VIF {"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lazy-loading 'pci_devices' on Instance uuid e7d2e9eb-f209-4d40-ba91-5145ae5256ce {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:47:54 user nova-compute[75216]:   <uuid>e7d2e9eb-f209-4d40-ba91-5145ae5256ce</uuid>
Nov 02 04:47:54 user nova-compute[75216]:   <name>instance-0000000d</name>
Nov 02 04:47:54 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:47:54 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:47:54 user nova-compute[75216]:   <metadata>
Nov 02 04:47:54 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:47:54 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:47:54 user nova-compute[75216]:       <nova:name>tempest-ServerActionsV293TestJSON-server-887008941</nova:name>
Nov 02 04:47:54 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:47:53</nova:creationTime>
Nov 02 04:47:54 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:47:54 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:47:54 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:47:54 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:47:54 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:47:54 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:47:54 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:47:54 user nova-compute[75216]:       <nova:owner>
Nov 02 04:47:54 user nova-compute[75216]:         <nova:user uuid="3d62e71597ef4d2fac3eb798fac76357">tempest-ServerActionsV293TestJSON-1935368242-project-member</nova:user>
Nov 02 04:47:54 user nova-compute[75216]:         <nova:project uuid="3feded7f0e024aa2b09aa6a76f73f0c3">tempest-ServerActionsV293TestJSON-1935368242</nova:project>
Nov 02 04:47:54 user nova-compute[75216]:       </nova:owner>
Nov 02 04:47:54 user nova-compute[75216]:       <nova:ports>
Nov 02 04:47:54 user nova-compute[75216]:         <nova:port uuid="737e2805-edf4-49cd-997e-f93852c268d1">
Nov 02 04:47:54 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:47:54 user nova-compute[75216]:         </nova:port>
Nov 02 04:47:54 user nova-compute[75216]:       </nova:ports>
Nov 02 04:47:54 user nova-compute[75216]:     </nova:instance>
Nov 02 04:47:54 user nova-compute[75216]:   </metadata>
Nov 02 04:47:54 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:47:54 user nova-compute[75216]:     <system>
Nov 02 04:47:54 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:47:54 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:47:54 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:47:54 user nova-compute[75216]:       <entry name="serial">e7d2e9eb-f209-4d40-ba91-5145ae5256ce</entry>
Nov 02 04:47:54 user nova-compute[75216]:       <entry name="uuid">e7d2e9eb-f209-4d40-ba91-5145ae5256ce</entry>
Nov 02 04:47:54 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:47:54 user nova-compute[75216]:     </system>
Nov 02 04:47:54 user nova-compute[75216]:   </sysinfo>
Nov 02 04:47:54 user nova-compute[75216]:   <os>
Nov 02 04:47:54 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:47:54 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:47:54 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:47:54 user nova-compute[75216]:   </os>
Nov 02 04:47:54 user nova-compute[75216]:   <features>
Nov 02 04:47:54 user nova-compute[75216]:     <acpi/>
Nov 02 04:47:54 user nova-compute[75216]:     <apic/>
Nov 02 04:47:54 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:47:54 user nova-compute[75216]:   </features>
Nov 02 04:47:54 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:47:54 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:47:54 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:47:54 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:47:54 user nova-compute[75216]:   </clock>
Nov 02 04:47:54 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:47:54 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:47:54 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:47:54 user nova-compute[75216]:   </cpu>
Nov 02 04:47:54 user nova-compute[75216]:   <devices>
Nov 02 04:47:54 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:47:54 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:47:54 user nova-compute[75216]:       <source dev="/dev/sdg"/>
Nov 02 04:47:54 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:47:54 user nova-compute[75216]:       <serial>8df56c1c-21c1-475a-90de-70a2e7a7c948</serial>
Nov 02 04:47:54 user nova-compute[75216]:     </disk>
Nov 02 04:47:54 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:47:54 user nova-compute[75216]:       <mac address="fa:16:3e:07:24:5c"/>
Nov 02 04:47:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:47:54 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:47:54 user nova-compute[75216]:       <target dev="tap737e2805-ed"/>
Nov 02 04:47:54 user nova-compute[75216]:     </interface>
Nov 02 04:47:54 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:47:54 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce/console.log" append="off"/>
Nov 02 04:47:54 user nova-compute[75216]:     </serial>
Nov 02 04:47:54 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:47:54 user nova-compute[75216]:     <video>
Nov 02 04:47:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:47:54 user nova-compute[75216]:     </video>
Nov 02 04:47:54 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:47:54 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:47:54 user nova-compute[75216]:     </rng>
Nov 02 04:47:54 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:47:54 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:47:54 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:47:54 user nova-compute[75216]:     </memballoon>
Nov 02 04:47:54 user nova-compute[75216]:   </devices>
Nov 02 04:47:54 user nova-compute[75216]: </domain>
Nov 02 04:47:54 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-887008941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-887008941',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikMoc+LjF47vbDkidZH2OP2JcfDYxU35Wr0fLVuf3xpHoPTwdOEtjII8qkbROyEovHT7tXE5H8ktlhKMgBrP7agimsJbCrj99IVLN7QhRVtQTlyVbrmLDd5mPkiSRl/Q==',key_name='tempest-keypair-1994893486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3feded7f0e024aa2b09aa6a76f73f0c3',ramdisk_id='',reservation_id='r-lkidyuac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1935368242',owner_user_name='tempest-ServerActionsV293TestJSON-1935368242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d62e71597ef4d2fac3eb798fac76357',uuid=e7d2e9eb-f209-4d40-ba91-5145ae5256ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converting VIF {"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG os_vif [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf63b651-1adc-534a-94b7-d2cd3cca3864', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap737e2805-ed, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap737e2805-ed, col_values=(('qos', UUID('605c0ed5-4931-47a0-a2b6-61d3ad0ba427')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap737e2805-ed, col_values=(('external_ids', {'iface-id': '737e2805-edf4-49cd-997e-f93852c268d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:24:5c', 'vm-uuid': 'e7d2e9eb-f209-4d40-ba91-5145ae5256ce'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:47:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:54 user nova-compute[75216]: INFO os_vif [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed')
Nov 02 04:47:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] No VIF found with MAC fa:16:3e:07:24:5c, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating instance_info_cache with network_info: [{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-47c895e2-1c0b-4e8e-8595-932310140b5d req-1764041d-3158-4776-8d64-65a5064cba55 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47c895e2-1c0b-4e8e-8595-932310140b5d req-1764041d-3158-4776-8d64-65a5064cba55 service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47c895e2-1c0b-4e8e-8595-932310140b5d req-1764041d-3158-4776-8d64-65a5064cba55 service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47c895e2-1c0b-4e8e-8595-932310140b5d req-1764041d-3158-4776-8d64-65a5064cba55 service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-47c895e2-1c0b-4e8e-8595-932310140b5d req-1764041d-3158-4776-8d64-65a5064cba55 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:55 user nova-compute[75216]: WARNING nova.compute.manager [req-47c895e2-1c0b-4e8e-8595-932310140b5d req-1764041d-3158-4776-8d64-65a5064cba55 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:47:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance destroyed successfully.
Nov 02 04:47:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Attempting a stable device rescue
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 04:47:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Creating image(s)
Nov 02 04:47:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "/opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "f77d1e159b7ca43f1e427358a1c8dcb37d29104a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "f77d1e159b7ca43f1e427358a1c8dcb37d29104a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-c6cbd86f-19f3-4456-8924-dcef4c64c2c2 req-e58b64a7-766f-46da-9b06-4b4865e97ac4 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6cbd86f-19f3-4456-8924-dcef4c64c2c2 req-e58b64a7-766f-46da-9b06-4b4865e97ac4 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6cbd86f-19f3-4456-8924-dcef4c64c2c2 req-e58b64a7-766f-46da-9b06-4b4865e97ac4 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6cbd86f-19f3-4456-8924-dcef4c64c2c2 req-e58b64a7-766f-46da-9b06-4b4865e97ac4 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-c6cbd86f-19f3-4456-8924-dcef4c64c2c2 req-e58b64a7-766f-46da-9b06-4b4865e97ac4 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No waiting events found dispatching network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:58 user nova-compute[75216]: WARNING nova.compute.manager [req-c6cbd86f-19f3-4456-8924-dcef4c64c2c2 req-e58b64a7-766f-46da-9b06-4b4865e97ac4 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received unexpected event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with vm_state building and task_state spawning.
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:58 user nova-compute[75216]: WARNING nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:58 user nova-compute[75216]: WARNING nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:58 user nova-compute[75216]: WARNING nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:58 user nova-compute[75216]: WARNING nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:58 user nova-compute[75216]: WARNING nova.compute.manager [req-3bf38668-c976-437a-bdc8-55a1a06437f8 req-b44a8b5e-d112-45fa-9370-966164aebe0d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.part --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.virt.images [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] 7fd43d16-fb64-498c-965b-247d4db7fd29 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.part /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.part /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.converted" returned: 0 in 0.486s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a.converted --force-share --output=json" returned: 0 in 0.250s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "f77d1e159b7ca43f1e427358a1c8dcb37d29104a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.180s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "f77d1e159b7ca43f1e427358a1c8dcb37d29104a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "f77d1e159b7ca43f1e427358a1c8dcb37d29104a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-a213a3b2-8eb2-4927-b5d0-9ffd93d12d0c req-181c4911-f2ed-4444-8612-a8482d6026a9 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a213a3b2-8eb2-4927-b5d0-9ffd93d12d0c req-181c4911-f2ed-4444-8612-a8482d6026a9 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a213a3b2-8eb2-4927-b5d0-9ffd93d12d0c req-181c4911-f2ed-4444-8612-a8482d6026a9 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a213a3b2-8eb2-4927-b5d0-9ffd93d12d0c req-181c4911-f2ed-4444-8612-a8482d6026a9 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-a213a3b2-8eb2-4927-b5d0-9ffd93d12d0c req-181c4911-f2ed-4444-8612-a8482d6026a9 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No waiting events found dispatching network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:47:59 user nova-compute[75216]: WARNING nova.compute.manager [req-a213a3b2-8eb2-4927-b5d0-9ffd93d12d0c req-181c4911-f2ed-4444-8612-a8482d6026a9 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received unexpected event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with vm_state building and task_state spawning.
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a --force-share --output=json" returned: 0 in 0.240s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a,backing_fmt=raw /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a,backing_fmt=raw /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue" returned: 0 in 0.066s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "f77d1e159b7ca43f1e427358a1c8dcb37d29104a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'migration_context' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<43182725-9f83-4afd-a243-49d838e7d811> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Start _get_guest_xml network_info=[{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "vif_mac": "fa:16:3e:9b:35:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fd43d16-fb64-498c-965b-247d4db7fd29', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '4149a010-0779-4265-9cc3-b9d0216686e0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYWhSnDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '43182725-9f83-4afd-a243-49d838e7d811', 'attached_at': '', 'detached_at': '', 'volume_id': '4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'serial': '4aa6dbad-6e4d-4a4d-925b-023e12f174e1'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'resources' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<43182725-9f83-4afd-a243-49d838e7d811> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'numa_topology' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<43182725-9f83-4afd-a243-49d838e7d811> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<43182725-9f83-4afd-a243-49d838e7d811> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYWhSnDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:47:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:47:59 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c4309e-08d5-4e04-a00f-ed7a44619da8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cYWhSnDV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 04:47:59 user nova-compute[75216]: node.name = iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:47:59 user nova-compute[75216]: node.tpgt = -1
Nov 02 04:47:59 user nova-compute[75216]: node.startup = automatic
Nov 02 04:47:59 user nova-compute[75216]: node.leading_login = No
Nov 02 04:47:59 user nova-compute[75216]: iface.iscsi_ifacename = default
Nov 02 04:47:59 user nova-compute[75216]: iface.net_ifacename = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.ipaddress = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.prefix_len = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.hwaddress = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.transport_name = tcp
Nov 02 04:47:59 user nova-compute[75216]: iface.initiatorname = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.state = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.vlan_id = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.vlan_priority = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.vlan_state = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.iface_num = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.mtu = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.port = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.bootproto = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.subnet_mask = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.gateway = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_alt_client_id = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_dns = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_learn_iqn = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_vendor_id_state = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_vendor_id = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.dhcp_slp_da = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.fragmentation = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.gratuitous_arp = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.incoming_forwarding = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.tos_state = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.tos = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.ttl = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.delayed_ack = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.tcp_nagle = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.tcp_wsf_state = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.tcp_wsf = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.tcp_timer_scale = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.tcp_timestamp = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.redirect = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.def_task_mgmt_timeout = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.header_digest = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.data_digest = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.immediate_data = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.initial_r2t = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.data_seq_inorder = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.data_pdu_inorder = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.erl = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.max_receive_data_len = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.first_burst_len = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.max_outstanding_r2t = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.max_burst_len = 0
Nov 02 04:47:59 user nova-compute[75216]: iface.chap_auth = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.bidi_chap = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.strict_login_compliance = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.discovery_auth = <empty>
Nov 02 04:47:59 user nova-compute[75216]: iface.discovery_logout = <empty>
Nov 02 04:47:59 user nova-compute[75216]: node.discovery_address = <empty>
Nov 02 04:47:59 user nova-compute[75216]: node.discovery_port = 0
Nov 02 04:47:59 user nova-compute[75216]: node.discovery_type = static
Nov 02 04:47:59 user nova-compute[75216]: node.session.initial_cmdsn = 0
Nov 02 04:47:59 user nova-compute[75216]: node.session.initial_login_retry_max = 8
Nov 02 04:47:59 user nova-compute[75216]: node.session.xmit_thread_priority = -20
Nov 02 04:47:59 user nova-compute[75216]: node.session.cmds_max = 128
Nov 02 04:47:59 user nova-compute[75216]: node.session.queue_depth = 32
Nov 02 04:47:59 user nova-compute[75216]: node.session.nr_sessions = 1
Nov 02 04:47:59 user nova-compute[75216]: node.session.auth.authmethod = CHAP
Nov 02 04:47:59 user nova-compute[75216]: node.session.auth.username = cYWhSnDV
Nov 02 04:47:59 user nova-compute[75216]: node.session.auth.password = ***
Nov 02 04:47:59 user nova-compute[75216]: node.session.auth.username_in = <empty>
Nov 02 04:47:59 user nova-compute[75216]: node.session.auth.password_in = <empty>
Nov 02 04:47:59 user nova-compute[75216]: node.session.auth.chap_algs = MD5
Nov 02 04:47:59 user nova-compute[75216]: node.session.timeo.replacement_timeout = 120
Nov 02 04:47:59 user nova-compute[75216]: node.session.err_timeo.abort_timeout = 15
Nov 02 04:47:59 user nova-compute[75216]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 04:47:59 user nova-compute[75216]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 04:47:59 user nova-compute[75216]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.FastAbort = Yes
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.InitialR2T = No
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.ImmediateData = Yes
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.MaxConnections = 1
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 04:47:59 user nova-compute[75216]: node.session.iscsi.ERL = 0
Nov 02 04:47:59 user nova-compute[75216]: node.session.scan = manual
Nov 02 04:47:59 user nova-compute[75216]: node.session.reopen_max = 0
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].address = 172.16.0.220
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].port = 3260
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].startup = manual
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].tcp.window_size = 524288
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].tcp.type_of_service = 0
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].timeo.logout_timeout = 15
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].timeo.login_timeout = 15
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].timeo.auth_timeout = 45
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].iscsi.DataDigest = None
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].iscsi.IFMarker = No
Nov 02 04:47:59 user nova-compute[75216]: node.conn[0].iscsi.OFMarker = No
Nov 02 04:47:59 user nova-compute[75216]: # END RECORD
Nov 02 04:47:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance spawned successfully.
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ad82a-a7b6-469c-ad1f-61d2cbaeb4bd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a85385-44d2-4f6a-8da6-88b58aaca15f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYWhSnDV {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYWhSnDV" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd4ab25-a65b-410d-82bd-711578dbbb0c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cYWhSnDV'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ac550-ca8d-4cc2-affe-f0c7487f2bb1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: INFO nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62f878-b415-41c9-a078-76f7274476c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:47:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.186s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] HCTL ('37', '0', '0', 0) found on session 12 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea73f79-c271-4b98-ba4f-e90bdb1fffd0]: (4, ('0 0 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching for a device in session 12 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYWhSnDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.215s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== connect_volume: return (217ms) {'type': 'block', 'scsi_wwn': '23433303833353565', 'path': '/dev/sdf'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303833353565', 'path': '/dev/sdf'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-662356066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-662356066',id=12,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-50m6mqgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:46:47Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=43182725-9f83-4afd-a243-49d838e7d811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "vif_mac": "fa:16:3e:9b:35:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "vif_mac": "fa:16:3e:9b:35:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'pci_devices' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<43182725-9f83-4afd-a243-49d838e7d811> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:47:59 user nova-compute[75216]:   <uuid>43182725-9f83-4afd-a243-49d838e7d811</uuid>
Nov 02 04:47:59 user nova-compute[75216]:   <name>instance-0000000c</name>
Nov 02 04:47:59 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:47:59 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:47:59 user nova-compute[75216]:   <metadata>
Nov 02 04:47:59 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:47:59 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:47:59 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-662356066</nova:name>
Nov 02 04:47:59 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:47:59</nova:creationTime>
Nov 02 04:47:59 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:47:59 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:47:59 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:47:59 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:47:59 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:47:59 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:47:59 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:47:59 user nova-compute[75216]:       <nova:owner>
Nov 02 04:47:59 user nova-compute[75216]:         <nova:user uuid="ae71d7b88da2452a9ec4489a0ef49176">tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member</nova:user>
Nov 02 04:47:59 user nova-compute[75216]:         <nova:project uuid="f6771c51304d446b8338d0d879ede48f">tempest-ServerBootFromVolumeStableRescueTest-1501080447</nova:project>
Nov 02 04:47:59 user nova-compute[75216]:       </nova:owner>
Nov 02 04:47:59 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:47:59 user nova-compute[75216]:       <nova:ports>
Nov 02 04:47:59 user nova-compute[75216]:         <nova:port uuid="1e2b5f1c-63f6-4ba4-883d-c528768387a4">
Nov 02 04:47:59 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 04:47:59 user nova-compute[75216]:         </nova:port>
Nov 02 04:47:59 user nova-compute[75216]:       </nova:ports>
Nov 02 04:47:59 user nova-compute[75216]:     </nova:instance>
Nov 02 04:47:59 user nova-compute[75216]:   </metadata>
Nov 02 04:47:59 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:47:59 user nova-compute[75216]:     <system>
Nov 02 04:47:59 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:47:59 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:47:59 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:47:59 user nova-compute[75216]:       <entry name="serial">43182725-9f83-4afd-a243-49d838e7d811</entry>
Nov 02 04:47:59 user nova-compute[75216]:       <entry name="uuid">43182725-9f83-4afd-a243-49d838e7d811</entry>
Nov 02 04:47:59 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:47:59 user nova-compute[75216]:     </system>
Nov 02 04:47:59 user nova-compute[75216]:   </sysinfo>
Nov 02 04:47:59 user nova-compute[75216]:   <os>
Nov 02 04:47:59 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:47:59 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:47:59 user nova-compute[75216]:   </os>
Nov 02 04:47:59 user nova-compute[75216]:   <features>
Nov 02 04:47:59 user nova-compute[75216]:     <acpi/>
Nov 02 04:47:59 user nova-compute[75216]:     <apic/>
Nov 02 04:47:59 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:47:59 user nova-compute[75216]:   </features>
Nov 02 04:47:59 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:47:59 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:47:59 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:47:59 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:47:59 user nova-compute[75216]:   </clock>
Nov 02 04:47:59 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:47:59 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:47:59 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:47:59 user nova-compute[75216]:   </cpu>
Nov 02 04:47:59 user nova-compute[75216]:   <devices>
Nov 02 04:47:59 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:47:59 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:47:59 user nova-compute[75216]:       <source dev="/dev/sdf"/>
Nov 02 04:47:59 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:47:59 user nova-compute[75216]:       <serial>4aa6dbad-6e4d-4a4d-925b-023e12f174e1</serial>
Nov 02 04:47:59 user nova-compute[75216]:     </disk>
Nov 02 04:47:59 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:47:59 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:47:59 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue"/>
Nov 02 04:47:59 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 04:47:59 user nova-compute[75216]:       <boot order="1"/>
Nov 02 04:47:59 user nova-compute[75216]:     </disk>
Nov 02 04:47:59 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:47:59 user nova-compute[75216]:       <mac address="fa:16:3e:9b:35:37"/>
Nov 02 04:47:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:47:59 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:47:59 user nova-compute[75216]:       <target dev="tap1e2b5f1c-63"/>
Nov 02 04:47:59 user nova-compute[75216]:     </interface>
Nov 02 04:47:59 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:47:59 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/console.log" append="off"/>
Nov 02 04:47:59 user nova-compute[75216]:     </serial>
Nov 02 04:47:59 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:47:59 user nova-compute[75216]:     <video>
Nov 02 04:47:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:47:59 user nova-compute[75216]:     </video>
Nov 02 04:47:59 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:47:59 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:47:59 user nova-compute[75216]:     </rng>
Nov 02 04:47:59 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:47:59 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:47:59 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:47:59 user nova-compute[75216]:     </memballoon>
Nov 02 04:47:59 user nova-compute[75216]:   </devices>
Nov 02 04:47:59 user nova-compute[75216]: </domain>
Nov 02 04:47:59 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:47:59 user nova-compute[75216]: INFO nova.compute.manager [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Took 31.34 seconds to build instance.
Nov 02 04:47:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance destroyed successfully.
Nov 02 04:47:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a125f241-4f6e-4701-a21a-ee734481962b tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.450s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No VIF found with MAC fa:16:3e:9b:35:37, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:47:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:48:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:48:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-f163379a-039e-4f47-a6ac-785bd37e1813 req-af810203-5605-4726-8ea7-a2412df6c11d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f163379a-039e-4f47-a6ac-785bd37e1813 req-af810203-5605-4726-8ea7-a2412df6c11d service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f163379a-039e-4f47-a6ac-785bd37e1813 req-af810203-5605-4726-8ea7-a2412df6c11d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f163379a-039e-4f47-a6ac-785bd37e1813 req-af810203-5605-4726-8ea7-a2412df6c11d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-f163379a-039e-4f47-a6ac-785bd37e1813 req-af810203-5605-4726-8ea7-a2412df6c11d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:01 user nova-compute[75216]: WARNING nova.compute.manager [req-f163379a-039e-4f47-a6ac-785bd37e1813 req-af810203-5605-4726-8ea7-a2412df6c11d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:48:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:48:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-49a60959-3cf1-4d47-a891-23ee7b29b591 req-5035e303-bef7-4182-a0bd-113b33d1048d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49a60959-3cf1-4d47-a891-23ee7b29b591 req-5035e303-bef7-4182-a0bd-113b33d1048d service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49a60959-3cf1-4d47-a891-23ee7b29b591 req-5035e303-bef7-4182-a0bd-113b33d1048d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49a60959-3cf1-4d47-a891-23ee7b29b591 req-5035e303-bef7-4182-a0bd-113b33d1048d service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-49a60959-3cf1-4d47-a891-23ee7b29b591 req-5035e303-bef7-4182-a0bd-113b33d1048d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:03 user nova-compute[75216]: WARNING nova.compute.manager [req-49a60959-3cf1-4d47-a891-23ee7b29b591 req-5035e303-bef7-4182-a0bd-113b33d1048d service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state rescuing.
Nov 02 04:48:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cb978b4-7abb-4cba-8476-2066c8f4cb59 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e31123e5-1b35-4456-af70-e6b3c058dae1', 'attached_at': '', 'detached_at': '', 'volume_id': '7e2e1e7a-db6e-4165-9e67-b54579d54813', 'serial': '7e2e1e7a-db6e-4165-9e67-b54579d54813'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGbqAdCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '632e2d96-6fbb-4fed-a24f-a786b724f0d9'}, 'status': 'reserved', 'instance': 'e31123e5-1b35-4456-af70-e6b3c058dae1', 'attached_at': '', 'detached_at': '', 'volume_id': '632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:48:05 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:05 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:05 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f195226-e27d-476c-bd44-4d1ef83f58fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:48:05 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9244e-0164-4a9d-a44d-d7eefea8ebbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813] added
Nov 02 04:48:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc63489b-9acb-42f0-82bc-8df9e13034c3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4befc525-40b8-44c1-80b7-56cf129a5b81]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UinCfPqh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UinCfPqh" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b08778-c6c6-4e17-a53e-b243827f8aeb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UinCfPqh'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e688c0c-6ea3-4fb8-8927-2323edf56409]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfe3155-9304-48d3-9da0-0de894e542e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e4285a-1e73-4d09-bfa7-833e2573d43d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]
Nov 02 04:48:06 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.
Nov 02 04:48:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a76633-a045-4bf6-ab0e-2281058b72e1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[15292d41-ff02-4159-925f-9d5cbc37ba4e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] HCTL ('41', '-', '-', 0) found on session 16 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[139026f8-8c3a-4b1f-bdba-34f72cbd400b]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '26666356166636661', 'path': '/dev/sdj'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666356166636661', 'path': '/dev/sdj'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lazy-loading 'flavor' on Instance uuid e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json" returned: 0 in 0.304s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 188743680 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:48:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7903MB free_disk=25.281429290771484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e31123e5-1b35-4456-af70-e6b3c058dae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 075b3db8-71aa-4bd7-8c7a-8cc5835594de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e7d2e9eb-f209-4d40-ba91-5145ae5256ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:48:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 290455552 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.017s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 436207616 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 576716800 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:48:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:48:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 726663168 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:48:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 861929472 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 988807168 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGbqAdCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '632e2d96-6fbb-4fed-a24f-a786b724f0d9'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:48:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[779d4ecc-964e-436d-82aa-0b01d1765bed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:48:12 user nova-compute[75216]: No targets found.
Nov 02 04:48:12 user nova-compute[75216]: iSNS:
Nov 02 04:48:12 user nova-compute[75216]: No targets found.
Nov 02 04:48:12 user nova-compute[75216]: STATIC:
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4
Nov 02 04:48:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:12 user nova-compute[75216]: FIRMWARE:
Nov 02 04:48:12 user nova-compute[75216]: No targets found.
Nov 02 04:48:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:48:12 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:48:12 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1b519-8bc7-4d03-8f65-a778ed63a772]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d717d335-f50f-4c0e-a26f-e2c46034a2b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4604157130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9'): ({'sdi'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Removing single pathed devices sdi {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updating instance_info_cache with network_info: [{"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ea0950-af58-41d8-a831-932e7044d70f]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-096b87b4-307f-4bda-8ad6-f0b0925aae54" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a8d7e-e275-4aa0-96ef-50808324542f]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Flushing IO for device /dev/sdi {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26547dcc-a28b-4e14-b1be-3b914f2485f2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee716c31-8473-406b-9428-1f7de18360eb]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf854d-a562-465e-950a-38fec77311ff]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2cf45d-0c88-4b8d-bb3e-1b8d2880100e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260]
Nov 02 04:48:12 user nova-compute[75216]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9, portal: 172.16.0.220,3260] successful.
Nov 02 04:48:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:632e2d96-6fbb-4fed-a24f-a786b724f0d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d494259-34de-46f5-bfb6-71ba01bea854]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] <== disconnect_volume: return (416ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'e31123e5-1b35-4456-af70-e6b3c058dae1', 'attached_at': '', 'detached_at': '', 'volume_id': '7e2e1e7a-db6e-4165-9e67-b54579d54813', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Nov 02 04:48:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] swap_volume: removing Cinder connection for volume 632e2d96-6fbb-4fed-a24f-a786b724f0d9 {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Nov 02 04:48:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] swap_volume: Updating volume 632e2d96-6fbb-4fed-a24f-a786b724f0d9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UinCfPqh", "auth_password": "X3hSTxyGBZKbvc", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "7e2e1e7a-db6e-4165-9e67-b54579d54813"}, "status": "reserved", "instance": "e31123e5-1b35-4456-af70-e6b3c058dae1", "attached_at": "", "detached_at": "", "volume_id": "7e2e1e7a-db6e-4165-9e67-b54579d54813", "serial": "7e2e1e7a-db6e-4165-9e67-b54579d54813"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7e2e1e7a-db6e-4165-9e67-b54579d54813', 'no_device': None, 'attachment_id': '89e2d36a-785e-4a5a-b4cb-936ac66671b8'} {{(pid=75216) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Nov 02 04:48:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf1a82f8-3172-49d5-8548-90380eb5478e tempest-TestVolumeSwap-1573672168 tempest-TestVolumeSwap-1573672168-project-admin] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 62.799s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:15 user nova-compute[75216]: INFO nova.compute.manager [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Detaching volume 7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:48:15 user nova-compute[75216]: INFO nova.virt.block_device [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Attempting to driver detach volume 7e2e1e7a-db6e-4165-9e67-b54579d54813 from mountpoint /dev/vdb
Nov 02 04:48:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Attempting to detach device vdb from instance e31123e5-1b35-4456-af70-e6b3c058dae1 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:48:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:48:15 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:48:15 user nova-compute[75216]:   <source dev="/dev/sdj"/>
Nov 02 04:48:15 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:48:15 user nova-compute[75216]:   <serial>7e2e1e7a-db6e-4165-9e67-b54579d54813</serial>
Nov 02 04:48:15 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:48:15 user nova-compute[75216]: </disk>
Nov 02 04:48:15 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:48:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Successfully detached device vdb from instance e31123e5-1b35-4456-af70-e6b3c058dae1 from the persistent domain config.
Nov 02 04:48:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e31123e5-1b35-4456-af70-e6b3c058dae1 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:48:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:48:15 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:48:15 user nova-compute[75216]:   <source dev="/dev/sdj"/>
Nov 02 04:48:15 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:48:15 user nova-compute[75216]:   <serial>7e2e1e7a-db6e-4165-9e67-b54579d54813</serial>
Nov 02 04:48:15 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:48:15 user nova-compute[75216]: </disk>
Nov 02 04:48:15 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:48:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-changed-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing instance network info cache due to event network-changed-fd720d4c-a08a-4b78-8d45-b88d578d6c42. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] Acquiring lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] Acquired lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:48:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Refreshing network info cache for port fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:48:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updated VIF entry in instance network info cache for port fd720d4c-a08a-4b78-8d45-b88d578d6c42. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:48:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:48:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b707d150-75d7-4082-975b-4088b59d0418 req-51c9003b-60a5-452f-b48f-aee7412e7727 service nova] Releasing lock "refresh_cache-075b3db8-71aa-4bd7-8c7a-8cc5835594de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:48:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:22 user nova-compute[75216]: INFO nova.compute.manager [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Terminating instance
Nov 02 04:48:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-2967d468-130c-4f79-af77-696493f9899b req-639bbc66-7042-4da7-88ea-54f1b5a5a44f service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2967d468-130c-4f79-af77-696493f9899b req-639bbc66-7042-4da7-88ea-54f1b5a5a44f service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2967d468-130c-4f79-af77-696493f9899b req-639bbc66-7042-4da7-88ea-54f1b5a5a44f service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2967d468-130c-4f79-af77-696493f9899b req-639bbc66-7042-4da7-88ea-54f1b5a5a44f service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-2967d468-130c-4f79-af77-696493f9899b req-639bbc66-7042-4da7-88ea-54f1b5a5a44f service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-unplugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-2967d468-130c-4f79-af77-696493f9899b req-639bbc66-7042-4da7-88ea-54f1b5a5a44f service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-3b9d33e7-de36-4831-b6ea-1fa60a4abe6c req-c1d2cc8b-2286-4612-b8d3-060e489f3519 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3b9d33e7-de36-4831-b6ea-1fa60a4abe6c req-c1d2cc8b-2286-4612-b8d3-060e489f3519 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3b9d33e7-de36-4831-b6ea-1fa60a4abe6c req-c1d2cc8b-2286-4612-b8d3-060e489f3519 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3b9d33e7-de36-4831-b6ea-1fa60a4abe6c req-c1d2cc8b-2286-4612-b8d3-060e489f3519 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-3b9d33e7-de36-4831-b6ea-1fa60a4abe6c req-c1d2cc8b-2286-4612-b8d3-060e489f3519 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-unplugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-3b9d33e7-de36-4831-b6ea-1fa60a4abe6c req-c1d2cc8b-2286-4612-b8d3-060e489f3519 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-d7b7928c-1624-4782-afbc-1bd04d4236d6 req-370f12d2-c3d8-460c-9bb2-ed9b621408a1 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7b7928c-1624-4782-afbc-1bd04d4236d6 req-370f12d2-c3d8-460c-9bb2-ed9b621408a1 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7b7928c-1624-4782-afbc-1bd04d4236d6 req-370f12d2-c3d8-460c-9bb2-ed9b621408a1 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7b7928c-1624-4782-afbc-1bd04d4236d6 req-370f12d2-c3d8-460c-9bb2-ed9b621408a1 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-d7b7928c-1624-4782-afbc-1bd04d4236d6 req-370f12d2-c3d8-460c-9bb2-ed9b621408a1 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-unplugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-d7b7928c-1624-4782-afbc-1bd04d4236d6 req-370f12d2-c3d8-460c-9bb2-ed9b621408a1 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Instance destroyed successfully.
Nov 02 04:48:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lazy-loading 'resources' on Instance uuid 075b3db8-71aa-4bd7-8c7a-8cc5835594de {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:1c:39,bridge_name='br-int',has_traffic_filtering=True,id=fd720d4c-a08a-4b78-8d45-b88d578d6c42,network=Network(2b311a5d-7f13-40ce-b866-8b802e105479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd720d4c-a0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:1c:39,bridge_name='br-int',has_traffic_filtering=True,id=fd720d4c-a08a-4b78-8d45-b88d578d6c42,network=Network(2b311a5d-7f13-40ce-b866-8b802e105479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd720d4c-a0') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd720d4c-a0, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43ed002c-0d2f-4e5f-a86a-67738e08fe4c) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: INFO os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:1c:39,bridge_name='br-int',has_traffic_filtering=True,id=fd720d4c-a08a-4b78-8d45-b88d578d6c42,network=Network(2b311a5d-7f13-40ce-b866-8b802e105479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd720d4c-a0')
Nov 02 04:48:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=fa0c4ab6-2102-4768-ab8a-9f4c62ccec07,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa0c4ab6-21') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=fa0c4ab6-2102-4768-ab8a-9f4c62ccec07,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa0c4ab6-21') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa0c4ab6-21, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=889e605b-6bd6-4bbe-9a4a-a46f749af80d) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:25 user nova-compute[75216]: WARNING nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-fd720d4c-a08a-4b78-8d45-b88d578d6c42 for instance with vm_state active and task_state deleting.
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-unplugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:25 user nova-compute[75216]: WARNING nova.compute.manager [req-695e7a91-e45c-4439-bdae-0f1addb3c9ec req-170e0d65-78c0-469b-91cd-f55c907e66c5 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e for instance with vm_state active and task_state deleting.
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: INFO os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=fa0c4ab6-2102-4768-ab8a-9f4c62ccec07,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa0c4ab6-21')
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:bc,bridge_name='br-int',has_traffic_filtering=True,id=3c0eac1c-1239-4eb3-b17d-59a8108676e3,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c0eac1c-12') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:bc,bridge_name='br-int',has_traffic_filtering=True,id=3c0eac1c-1239-4eb3-b17d-59a8108676e3,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c0eac1c-12') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c0eac1c-12, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd0f6c96-45fc-425b-8c30-0d02495ec3ae) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: INFO os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:bc,bridge_name='br-int',has_traffic_filtering=True,id=3c0eac1c-1239-4eb3-b17d-59a8108676e3,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c0eac1c-12')
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "25a7183c-696f-4591-a10e-c7b247ce24f8", "address": "fa:16:3e:e5:59:90", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25a7183c-69", "ovs_interfaceid": "25a7183c-696f-4591-a10e-c7b247ce24f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:59:90,bridge_name='br-int',has_traffic_filtering=True,id=25a7183c-696f-4591-a10e-c7b247ce24f8,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a7183c-69') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:59:90,bridge_name='br-int',has_traffic_filtering=True,id=25a7183c-696f-4591-a10e-c7b247ce24f8,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a7183c-69') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25a7183c-69, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-4607e286-b8ba-440e-ae33-56c1e13bfb65 req-7642564d-6637-4dea-b8f8-5bf35daa49ad service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4607e286-b8ba-440e-ae33-56c1e13bfb65 req-7642564d-6637-4dea-b8f8-5bf35daa49ad service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4607e286-b8ba-440e-ae33-56c1e13bfb65 req-7642564d-6637-4dea-b8f8-5bf35daa49ad service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4607e286-b8ba-440e-ae33-56c1e13bfb65 req-7642564d-6637-4dea-b8f8-5bf35daa49ad service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-4607e286-b8ba-440e-ae33-56c1e13bfb65 req-7642564d-6637-4dea-b8f8-5bf35daa49ad service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:25 user nova-compute[75216]: WARNING nova.compute.manager [req-4607e286-b8ba-440e-ae33-56c1e13bfb65 req-7642564d-6637-4dea-b8f8-5bf35daa49ad service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-3c0eac1c-1239-4eb3-b17d-59a8108676e3 for instance with vm_state active and task_state deleting.
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ad7ee7d-cb03-4333-8d39-9b046748924f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: INFO os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:59:90,bridge_name='br-int',has_traffic_filtering=True,id=25a7183c-696f-4591-a10e-c7b247ce24f8,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25a7183c-69')
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:1b:f7,bridge_name='br-int',has_traffic_filtering=True,id=401a8b69-4f19-4848-8643-e69bce5bf926,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401a8b69-4f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:1b:f7,bridge_name='br-int',has_traffic_filtering=True,id=401a8b69-4f19-4848-8643-e69bce5bf926,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401a8b69-4f') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap401a8b69-4f, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d78e8cbd-4c4f-481a-a37c-774e97be824b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: INFO os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:1b:f7,bridge_name='br-int',has_traffic_filtering=True,id=401a8b69-4f19-4848-8643-e69bce5bf926,network=Network(66123c6a-505f-473d-b16d-83bba08764c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401a8b69-4f')
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:23,bridge_name='br-int',has_traffic_filtering=True,id=ad9448fb-8767-4ee1-8f84-d004f78ce062,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9448fb-87') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:23,bridge_name='br-int',has_traffic_filtering=True,id=ad9448fb-8767-4ee1-8f84-d004f78ce062,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9448fb-87') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad9448fb-87, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc24c40f-31a2-43a1-9dd9-a0fcde5ad1a3) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: INFO os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:74:23,bridge_name='br-int',has_traffic_filtering=True,id=ad9448fb-8767-4ee1-8f84-d004f78ce062,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9448fb-87')
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1609511547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1609511547',id=10,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5GoCB7N0xyfJbOMhRyhyAgf/pE+8BInY0uF1BSiKweRz7hFdf7XkHBZttDR18JbGYRhN3fG3i3rJgWDnlJvOk5aT/QZptiPu8UXv48mr+566h/uiAqIacdLbletZvYAg==',key_name='tempest-keypair-225796355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bf82914e81741ce84c804211ad49e7d',ramdisk_id='',reservation_id='r-bjnehndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684275739',owner_user_name='tempest-TaggedBootDevicesTest-684275739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bfecda6e9e74983bbfc99909cd4f53c',uuid=075b3db8-71aa-4bd7-8c7a-8cc5835594de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converting VIF {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:11:46,bridge_name='br-int',has_traffic_filtering=True,id=3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ebfabc4-4c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:11:46,bridge_name='br-int',has_traffic_filtering=True,id=3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ebfabc4-4c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ebfabc4-4c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51dd196a-1fe5-4fdf-8774-09d528eaec1f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:25 user nova-compute[75216]: INFO os_vif [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:11:46,bridge_name='br-int',has_traffic_filtering=True,id=3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e,network=Network(71075f7c-a75b-4427-a0ee-7eb98f7247f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ebfabc4-4c')
Nov 02 04:48:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoCbihm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:48:25 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97952aff-1b67-4f9c-9053-acc7d529029d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:48:25 user nova-compute[75216]: No targets found.
Nov 02 04:48:25 user nova-compute[75216]: iSNS:
Nov 02 04:48:25 user nova-compute[75216]: No targets found.
Nov 02 04:48:25 user nova-compute[75216]: STATIC:
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4
Nov 02 04:48:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:25 user nova-compute[75216]: FIRMWARE:
Nov 02 04:48:25 user nova-compute[75216]: No targets found.
Nov 02 04:48:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:48:25 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:48:25 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff007c2a-2b72-4f44-aad8-5c020edcbfd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.159s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e7eb4-ac0b-45e7-940b-b71803476e69]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec43d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980'): ({'sdh'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Removing single pathed devices sdh {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:26 user nova-compute[75216]: WARNING nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-fa0c4ab6-2102-4768-ab8a-9f4c62ccec07 for instance with vm_state active and task_state deleting.
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-unplugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-25a7183c-696f-4591-a10e-c7b247ce24f8 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:26 user nova-compute[75216]: WARNING nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-25a7183c-696f-4591-a10e-c7b247ce24f8 for instance with vm_state active and task_state deleting.
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-unplugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-401a8b69-4f19-4848-8643-e69bce5bf926 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:26 user nova-compute[75216]: WARNING nova.compute.manager [req-b85199ef-9a5d-47f2-b7af-239fd9ddb678 req-704cb78b-a7de-4a5f-b907-4ab0b25a4f30 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-401a8b69-4f19-4848-8643-e69bce5bf926 for instance with vm_state active and task_state deleting.
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9d728-f04c-4eeb-99dc-eceb9b016969]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef132fc1-aff4-4d1f-92f6-b097d6c10182]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Flushing IO for device /dev/sdh {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e40ab5d-ec8f-4d80-921e-47ef43ebb54e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d83291-fa75-4b21-a889-1161c731df77]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] SCSI volumes sdh have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7db55b-0da8-4bf2-8877-b69a48bd8412]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[02618981-0120-43e0-9a56-ad891a074a83]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260]
Nov 02 04:48:26 user nova-compute[75216]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980, portal: 172.16.0.220,3260] successful.
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:212297cc-75e7-4f72-9840-454871258980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd427e0a-cbaa-4d7c-a790-791252cb9971]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.579s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== disconnect_volume: return (581ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqiyGhgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:48:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b2cf84-0738-4428-9a46-7de17cbf5f1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:48:26 user nova-compute[75216]: No targets found.
Nov 02 04:48:26 user nova-compute[75216]: iSNS:
Nov 02 04:48:26 user nova-compute[75216]: No targets found.
Nov 02 04:48:26 user nova-compute[75216]: STATIC:
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: FIRMWARE:
Nov 02 04:48:26 user nova-compute[75216]: No targets found.
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:48:26 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:48:26 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4f838-5d0e-4a07-87aa-429e6e079d71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[08305b60-1766-4c49-b35c-85d6dc655ab8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec43d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca52c65-0e9b-494a-8a0a-1c3cf0a3b558]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[605089fa-2c02-4528-b30e-832e3829d65d]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d46df8a-fa3f-41dc-b799-999d4331abcb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c134c225-caa7-4c05-a99e-bc1b140aa37e]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc769c4e-af7d-49fa-8028-c02536a62fa4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c842e0-0fd1-44c8-89a8-ff3ac17d47bc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260]
Nov 02 04:48:26 user nova-compute[75216]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed, portal: 172.16.0.220,3260] successful.
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3211f4e2-6987-4b49-a1f7-04d87be936ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ba40fd-e2c0-4128-93bf-2f9cee68a8dc]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== disconnect_volume: return (490ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDIKbYPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:48:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[756c1598-556e-43b3-92c7-46f9333a9096]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:48:26 user nova-compute[75216]: No targets found.
Nov 02 04:48:26 user nova-compute[75216]: iSNS:
Nov 02 04:48:26 user nova-compute[75216]: No targets found.
Nov 02 04:48:26 user nova-compute[75216]: STATIC:
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4
Nov 02 04:48:26 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:26 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:26 user nova-compute[75216]: FIRMWARE:
Nov 02 04:48:26 user nova-compute[75216]: No targets found.
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:48:26 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:48:26 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7d15b-607d-42f8-8cd9-4e527145cb76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a96061b-8ec6-420e-ace4-86a7f342d1e0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5a36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2715b2-470b-4014-b1ba-01d6a41cb879]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0bfac5-6e5e-4b0f-9cfe-0dc14db1d743]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7301f-daa3-454c-96ce-acbf17268d52]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[434d42ae-fb7e-474a-a9e4-f76f99791533]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242726d-287a-4002-a44b-20f7ba65fbe8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96997ea-8518-422e-b0f9-212195549930]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260]
Nov 02 04:48:27 user nova-compute[75216]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4, portal: 172.16.0.220,3260] successful.
Nov 02 04:48:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:471e5f4a-1bf3-41ac-ba4c-4db53a3e37d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ba4d0-aca9-42e2-bf90-2b403a1f75b1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] <== disconnect_volume: return (437ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:48:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Deleting instance files /opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de_del
Nov 02 04:48:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Deletion of /opt/stack/data/nova/instances/075b3db8-71aa-4bd7-8c7a-8cc5835594de_del complete
Nov 02 04:48:27 user nova-compute[75216]: INFO nova.compute.manager [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Took 4.89 seconds to destroy the instance on the hypervisor.
Nov 02 04:48:27 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:48:27 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-unplugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-unplugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] Acquiring lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] No waiting events found dispatching network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:28 user nova-compute[75216]: WARNING nova.compute.manager [req-0a2d5a28-79c4-45d8-b2d5-1f7584ad5f32 req-caa43183-8160-4b11-9d76-b7635a39acb0 service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received unexpected event network-vif-plugged-ad9448fb-8767-4ee1-8f84-d004f78ce062 for instance with vm_state active and task_state deleting.
Nov 02 04:48:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-c13fbf1a-c4fd-4818-8e27-8b10d69ac3da req-003d72eb-cee5-45df-acee-3504f7c800eb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-deleted-25a7183c-696f-4591-a10e-c7b247ce24f8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:29 user nova-compute[75216]: INFO nova.compute.manager [req-c13fbf1a-c4fd-4818-8e27-8b10d69ac3da req-003d72eb-cee5-45df-acee-3504f7c800eb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Neutron deleted interface 25a7183c-696f-4591-a10e-c7b247ce24f8; detaching it from the instance and deleting it from the info cache
Nov 02 04:48:29 user nova-compute[75216]: DEBUG nova.network.neutron [req-c13fbf1a-c4fd-4818-8e27-8b10d69ac3da req-003d72eb-cee5-45df-acee-3504f7c800eb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [{"id": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "address": "fa:16:3e:90:1c:39", "network": {"id": "2b311a5d-7f13-40ce-b866-8b802e105479", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1333532608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd720d4c-a0", "ovs_interfaceid": "fd720d4c-a08a-4b78-8d45-b88d578d6c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "address": "fa:16:3e:5c:9f:cb", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0c4ab6-21", "ovs_interfaceid": "fa0c4ab6-2102-4768-ab8a-9f4c62ccec07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "address": "fa:16:3e:fa:c9:bc", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0eac1c-12", "ovs_interfaceid": "3c0eac1c-1239-4eb3-b17d-59a8108676e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "401a8b69-4f19-4848-8643-e69bce5bf926", "address": "fa:16:3e:63:1b:f7", "network": {"id": "66123c6a-505f-473d-b16d-83bba08764c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813162506", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401a8b69-4f", "ovs_interfaceid": "401a8b69-4f19-4848-8643-e69bce5bf926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "address": "fa:16:3e:05:74:23", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9448fb-87", "ovs_interfaceid": "ad9448fb-8767-4ee1-8f84-d004f78ce062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "address": "fa:16:3e:39:11:46", "network": {"id": "71075f7c-a75b-4427-a0ee-7eb98f7247f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1990458523", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9bf82914e81741ce84c804211ad49e7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ebfabc4-4c", "ovs_interfaceid": "3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:48:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-c13fbf1a-c4fd-4818-8e27-8b10d69ac3da req-003d72eb-cee5-45df-acee-3504f7c800eb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Detach interface failed, port_id=25a7183c-696f-4591-a10e-c7b247ce24f8, reason: Instance 075b3db8-71aa-4bd7-8c7a-8cc5835594de could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:48:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:29 user nova-compute[75216]: INFO nova.compute.manager [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Detaching volume 971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:48:29 user nova-compute[75216]: INFO nova.virt.block_device [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Attempting to driver detach volume 971421e3-d718-4518-ab97-0650b558c700 from mountpoint /dev/vdb
Nov 02 04:48:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Attempting to detach device vdb from instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:48:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:48:29 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:48:29 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:48:29 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:48:29 user nova-compute[75216]:   <serial>971421e3-d718-4518-ab97-0650b558c700</serial>
Nov 02 04:48:29 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:48:29 user nova-compute[75216]: </disk>
Nov 02 04:48:29 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:48:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully detached device vdb from instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab from the persistent domain config.
Nov 02 04:48:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:48:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:48:29 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:48:29 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:48:29 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:48:29 user nova-compute[75216]:   <serial>971421e3-d718-4518-ab97-0650b558c700</serial>
Nov 02 04:48:29 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:48:29 user nova-compute[75216]: </disk>
Nov 02 04:48:29 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:48:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:48:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:31 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:48:31 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Took 3.98 seconds to deallocate network for instance.
Nov 02 04:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b9a4b006-888c-48e8-9fa3-d188fc23e846 req-3ca3884b-9852-4c72-95e4-c31deea516bb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-deleted-fd720d4c-a08a-4b78-8d45-b88d578d6c42 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b9a4b006-888c-48e8-9fa3-d188fc23e846 req-3ca3884b-9852-4c72-95e4-c31deea516bb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-deleted-ad9448fb-8767-4ee1-8f84-d004f78ce062 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b9a4b006-888c-48e8-9fa3-d188fc23e846 req-3ca3884b-9852-4c72-95e4-c31deea516bb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-deleted-3ebfabc4-4c79-4fec-ab31-0d2569bd2d8e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b9a4b006-888c-48e8-9fa3-d188fc23e846 req-3ca3884b-9852-4c72-95e4-c31deea516bb service nova] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Received event network-vif-deleted-401a8b69-4f19-4848-8643-e69bce5bf926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:34 user nova-compute[75216]: INFO nova.compute.manager [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] [instance: 075b3db8-71aa-4bd7-8c7a-8cc5835594de] Took 3.08 seconds to detach 3 volumes for instance.
Nov 02 04:48:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:48:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:48:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:34 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Deleted allocations for instance 075b3db8-71aa-4bd7-8c7a-8cc5835594de
Nov 02 04:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-218bea43-17b4-4b0d-9002-e270093a43ed tempest-TaggedBootDevicesTest-684275739 tempest-TaggedBootDevicesTest-684275739-project-member] Lock "075b3db8-71aa-4bd7-8c7a-8cc5835594de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.474s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:35 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e31123e5-1b35-4456-af70-e6b3c058dae1 is timed out.
Nov 02 04:48:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Successfully detached device vdb from instance e31123e5-1b35-4456-af70-e6b3c058dae1 from the live domain config.
Nov 02 04:48:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UinCfPqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '7e2e1e7a-db6e-4165-9e67-b54579d54813'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:48:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd46f4cc-3ab8-4c9e-a242-de65b853e087]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:48:35 user nova-compute[75216]: No targets found.
Nov 02 04:48:35 user nova-compute[75216]: iSNS:
Nov 02 04:48:35 user nova-compute[75216]: No targets found.
Nov 02 04:48:35 user nova-compute[75216]: STATIC:
Nov 02 04:48:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:48:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813
Nov 02 04:48:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:48:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:48:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:48:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:35 user nova-compute[75216]: FIRMWARE:
Nov 02 04:48:35 user nova-compute[75216]: No targets found.
Nov 02 04:48:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:48:35 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:48:35 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5525543f-d6bd-4406-9d42-3674f3cecbaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac34ec-5dc2-4e19-9810-becdd71fb7a0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec435750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813'): ({'sdj'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Removing single pathed devices sdj {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda65053-ca7e-4c04-bad4-fc5ed5422caa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1214f-ca8c-45e6-9328-5f2ebd7e23fb]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Flushing IO for device /dev/sdj {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a0143b-01a9-4ff8-917a-cf42cf867513]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aaed5e-9dee-4a22-8ad7-b185d1b5402b]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] SCSI volumes sdj have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9e5cc1-76fb-4772-9409-76632dc528d3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b330b733-0a4b-4ce5-9175-ace3ab72f09c]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260]
Nov 02 04:48:36 user nova-compute[75216]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813, portal: 172.16.0.220,3260] successful.
Nov 02 04:48:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2e1e7a-db6e-4165-9e67-b54579d54813 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ac6c14-9463-4ecc-9986-6a6974bd6927]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] <== disconnect_volume: return (325ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:48:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:48:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:48:39 user nova-compute[75216]: INFO nova.compute.claims [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Claim successful on node user
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:48:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.policy [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62b4c824a20b4980adda4a3821b28e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78fab3926a14516be58c49540110c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:48:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Creating image(s)
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "/opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "/opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "/opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk 1073741824" returned: 0 in 0.066s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Successfully created port: 07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lazy-loading 'flavor' on Instance uuid e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Cannot resize image /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Ensure instance console log exists: /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b36ab131-a9f2-456e-9853-d8b3a904885b tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.683s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Successfully updated port: 07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquired lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-changed-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Refreshing instance network info cache due to event network-changed-07462512-5214-4591-9a71-ba1994ef82d2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] Acquiring lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updating instance_info_cache with network_info: [{"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Releasing lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Instance network_info: |[{"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] Acquired lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Refreshing network info cache for port 07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Start _get_guest_xml network_info=[{"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:48:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:48:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1848345043',display_name='tempest-VolumesAdminNegativeTest-server-1848345043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1848345043',id=14,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTvrrN+s5BBkQbObCpyQAlVCGkB7seKQEJ9eQvvT5TIu/3hhD8mr6NAGOfU1WRj6OLsnn8Kp4QqhNVxl0xxTwmD3TV8OevU0Al0SLnvtJwyqgHPeFK/W6ojAy783UkYbg==',key_name='tempest-keypair-447207878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78fab3926a14516be58c49540110c07',ramdisk_id='',reservation_id='r-s6ngfjsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1191324499',owner_user_name='tempest-VolumesAdminNegativeTest-1191324499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62b4c824a20b4980adda4a3821b28e3c',uuid=a61cce9f-24a3-4538-be2d-30b562825a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converting VIF {"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:58:97,bridge_name='br-int',has_traffic_filtering=True,id=07462512-5214-4591-9a71-ba1994ef82d2,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07462512-52') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lazy-loading 'pci_devices' on Instance uuid a61cce9f-24a3-4538-be2d-30b562825a16 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:48:41 user nova-compute[75216]:   <uuid>a61cce9f-24a3-4538-be2d-30b562825a16</uuid>
Nov 02 04:48:41 user nova-compute[75216]:   <name>instance-0000000e</name>
Nov 02 04:48:41 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:48:41 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:48:41 user nova-compute[75216]:   <metadata>
Nov 02 04:48:41 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:48:41 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:48:41 user nova-compute[75216]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1848345043</nova:name>
Nov 02 04:48:41 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:48:41</nova:creationTime>
Nov 02 04:48:41 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:48:41 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:48:41 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:48:41 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:48:41 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:48:41 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:48:41 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:48:41 user nova-compute[75216]:       <nova:owner>
Nov 02 04:48:41 user nova-compute[75216]:         <nova:user uuid="62b4c824a20b4980adda4a3821b28e3c">tempest-VolumesAdminNegativeTest-1191324499-project-member</nova:user>
Nov 02 04:48:41 user nova-compute[75216]:         <nova:project uuid="a78fab3926a14516be58c49540110c07">tempest-VolumesAdminNegativeTest-1191324499</nova:project>
Nov 02 04:48:41 user nova-compute[75216]:       </nova:owner>
Nov 02 04:48:41 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:48:41 user nova-compute[75216]:       <nova:ports>
Nov 02 04:48:41 user nova-compute[75216]:         <nova:port uuid="07462512-5214-4591-9a71-ba1994ef82d2">
Nov 02 04:48:41 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 04:48:41 user nova-compute[75216]:         </nova:port>
Nov 02 04:48:41 user nova-compute[75216]:       </nova:ports>
Nov 02 04:48:41 user nova-compute[75216]:     </nova:instance>
Nov 02 04:48:41 user nova-compute[75216]:   </metadata>
Nov 02 04:48:41 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:48:41 user nova-compute[75216]:     <system>
Nov 02 04:48:41 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:48:41 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:48:41 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:48:41 user nova-compute[75216]:       <entry name="serial">a61cce9f-24a3-4538-be2d-30b562825a16</entry>
Nov 02 04:48:41 user nova-compute[75216]:       <entry name="uuid">a61cce9f-24a3-4538-be2d-30b562825a16</entry>
Nov 02 04:48:41 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:48:41 user nova-compute[75216]:     </system>
Nov 02 04:48:41 user nova-compute[75216]:   </sysinfo>
Nov 02 04:48:41 user nova-compute[75216]:   <os>
Nov 02 04:48:41 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:48:41 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:48:41 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:48:41 user nova-compute[75216]:   </os>
Nov 02 04:48:41 user nova-compute[75216]:   <features>
Nov 02 04:48:41 user nova-compute[75216]:     <acpi/>
Nov 02 04:48:41 user nova-compute[75216]:     <apic/>
Nov 02 04:48:41 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:48:41 user nova-compute[75216]:   </features>
Nov 02 04:48:41 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:48:41 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:48:41 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:48:41 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:48:41 user nova-compute[75216]:   </clock>
Nov 02 04:48:41 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:48:41 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:48:41 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:48:41 user nova-compute[75216]:   </cpu>
Nov 02 04:48:41 user nova-compute[75216]:   <devices>
Nov 02 04:48:41 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:48:41 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:48:41 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk"/>
Nov 02 04:48:41 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:48:41 user nova-compute[75216]:     </disk>
Nov 02 04:48:41 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:48:41 user nova-compute[75216]:       <mac address="fa:16:3e:50:58:97"/>
Nov 02 04:48:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:48:41 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:48:41 user nova-compute[75216]:       <target dev="tap07462512-52"/>
Nov 02 04:48:41 user nova-compute[75216]:     </interface>
Nov 02 04:48:41 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:48:41 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/console.log" append="off"/>
Nov 02 04:48:41 user nova-compute[75216]:     </serial>
Nov 02 04:48:41 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:48:41 user nova-compute[75216]:     <video>
Nov 02 04:48:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:48:41 user nova-compute[75216]:     </video>
Nov 02 04:48:41 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:48:41 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:48:41 user nova-compute[75216]:     </rng>
Nov 02 04:48:41 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:48:41 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:48:41 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:48:41 user nova-compute[75216]:     </memballoon>
Nov 02 04:48:41 user nova-compute[75216]:   </devices>
Nov 02 04:48:41 user nova-compute[75216]: </domain>
Nov 02 04:48:41 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1848345043',display_name='tempest-VolumesAdminNegativeTest-server-1848345043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1848345043',id=14,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTvrrN+s5BBkQbObCpyQAlVCGkB7seKQEJ9eQvvT5TIu/3hhD8mr6NAGOfU1WRj6OLsnn8Kp4QqhNVxl0xxTwmD3TV8OevU0Al0SLnvtJwyqgHPeFK/W6ojAy783UkYbg==',key_name='tempest-keypair-447207878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78fab3926a14516be58c49540110c07',ramdisk_id='',reservation_id='r-s6ngfjsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1191324499',owner_user_name='tempest-VolumesAdminNegativeTest-1191324499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62b4c824a20b4980adda4a3821b28e3c',uuid=a61cce9f-24a3-4538-be2d-30b562825a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converting VIF {"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:58:97,bridge_name='br-int',has_traffic_filtering=True,id=07462512-5214-4591-9a71-ba1994ef82d2,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07462512-52') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG os_vif [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:58:97,bridge_name='br-int',has_traffic_filtering=True,id=07462512-5214-4591-9a71-ba1994ef82d2,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07462512-52') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5e7ac73-d3cd-5890-a208-c7786dac0277', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07462512-52, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07462512-52, col_values=(('qos', UUID('dff96d39-9ad3-4c6d-ab3c-1b89731d8583')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07462512-52, col_values=(('external_ids', {'iface-id': '07462512-5214-4591-9a71-ba1994ef82d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:58:97', 'vm-uuid': 'a61cce9f-24a3-4538-be2d-30b562825a16'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:41 user nova-compute[75216]: INFO os_vif [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:58:97,bridge_name='br-int',has_traffic_filtering=True,id=07462512-5214-4591-9a71-ba1994ef82d2,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07462512-52')
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] No VIF found with MAC fa:16:3e:50:58:97, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updated VIF entry in instance network info cache for port 07462512-5214-4591-9a71-ba1994ef82d2. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updating instance_info_cache with network_info: [{"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:48:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b8514a88-d9f2-4327-89c4-ca48c6d0a319 req-eec13393-21a5-4ff2-bc0c-3c400c9b3dbe service nova] Releasing lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ce8b1cd-220c-4242-a8ee-0ad1396d745c req-5811539c-da85-4879-a207-1f558866c298 service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ce8b1cd-220c-4242-a8ee-0ad1396d745c req-5811539c-da85-4879-a207-1f558866c298 service nova] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ce8b1cd-220c-4242-a8ee-0ad1396d745c req-5811539c-da85-4879-a207-1f558866c298 service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ce8b1cd-220c-4242-a8ee-0ad1396d745c req-5811539c-da85-4879-a207-1f558866c298 service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ce8b1cd-220c-4242-a8ee-0ad1396d745c req-5811539c-da85-4879-a207-1f558866c298 service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] No waiting events found dispatching network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:43 user nova-compute[75216]: WARNING nova.compute.manager [req-1ce8b1cd-220c-4242-a8ee-0ad1396d745c req-5811539c-da85-4879-a207-1f558866c298 service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received unexpected event network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 for instance with vm_state building and task_state spawning.
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:48:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Instance spawned successfully.
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:48:45 user nova-compute[75216]: INFO nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-f5ecc9ce-efc7-4ea1-9a7e-a59bf4f05211 req-d9c2a148-95d8-46d2-84ef-3bdac35660ce service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f5ecc9ce-efc7-4ea1-9a7e-a59bf4f05211 req-d9c2a148-95d8-46d2-84ef-3bdac35660ce service nova] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f5ecc9ce-efc7-4ea1-9a7e-a59bf4f05211 req-d9c2a148-95d8-46d2-84ef-3bdac35660ce service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f5ecc9ce-efc7-4ea1-9a7e-a59bf4f05211 req-d9c2a148-95d8-46d2-84ef-3bdac35660ce service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-f5ecc9ce-efc7-4ea1-9a7e-a59bf4f05211 req-d9c2a148-95d8-46d2-84ef-3bdac35660ce service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] No waiting events found dispatching network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:48:45 user nova-compute[75216]: WARNING nova.compute.manager [req-f5ecc9ce-efc7-4ea1-9a7e-a59bf4f05211 req-d9c2a148-95d8-46d2-84ef-3bdac35660ce service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received unexpected event network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 for instance with vm_state building and task_state spawning.
Nov 02 04:48:45 user nova-compute[75216]: INFO nova.compute.manager [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Took 6.22 seconds to build instance.
Nov 02 04:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-69ab7a3e-3b51-48c3-a961-7f72edef01c5 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab is timed out.
Nov 02 04:48:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully detached device vdb from instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab from the live domain config.
Nov 02 04:48:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bzTkDOji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:48:50 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[089055fe-688d-4386-9009-70e8093ab4b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:48:50 user nova-compute[75216]: No targets found.
Nov 02 04:48:50 user nova-compute[75216]: iSNS:
Nov 02 04:48:50 user nova-compute[75216]: No targets found.
Nov 02 04:48:50 user nova-compute[75216]: STATIC:
Nov 02 04:48:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700
Nov 02 04:48:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:50 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:48:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:50 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:48:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:50 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:48:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:48:50 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:48:50 user nova-compute[75216]: FIRMWARE:
Nov 02 04:48:50 user nova-compute[75216]: No targets found.
Nov 02 04:48:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:48:50 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:48:50 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[160cce02-84e4-4adc-88e8-1c49b3ce3aa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c72cd-3dd3-4460-ac7c-410c2119ed8b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 (non-flash)
Nov 02 04:48:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246b747-a972-4c28-8cc0-059c49419c99]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[493f5c40-156c-4dc7-a816-22dcce414e04]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[470dc4ad-c08e-49a2-ada1-654a722bbe0f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b7c0c-5b82-4d8e-be28-4f5096c43f14]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b4bfe-374d-4abc-b1e3-92f62a554b97]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d068ef45-8e23-4778-a444-8857afac2d4f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260]
Nov 02 04:48:50 user nova-compute[75216]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700, portal: 172.16.0.220,3260] successful.
Nov 02 04:48:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971421e3-d718-4518-ab97-0650b558c700 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeddbb12-5fe0-44b1-b522-80341805315d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== disconnect_volume: return (332ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:48:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:48:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:48:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid a2b40b8c-5b97-4bf8-adad-647ff27e2bab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-51b37259-9bd1-49c9-be80-e203717b645c tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:48:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:48:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:48:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 04:48:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:05 user nova-compute[75216]: INFO nova.compute.manager [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Terminating instance
Nov 02 04:49:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-49fb7404-491e-459c-877d-2a8126c21e2e req-7f97e332-db23-4fce-baf6-496e532bcb19 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-vif-unplugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49fb7404-491e-459c-877d-2a8126c21e2e req-7f97e332-db23-4fce-baf6-496e532bcb19 service nova] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49fb7404-491e-459c-877d-2a8126c21e2e req-7f97e332-db23-4fce-baf6-496e532bcb19 service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49fb7404-491e-459c-877d-2a8126c21e2e req-7f97e332-db23-4fce-baf6-496e532bcb19 service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-49fb7404-491e-459c-877d-2a8126c21e2e req-7f97e332-db23-4fce-baf6-496e532bcb19 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] No waiting events found dispatching network-vif-unplugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-49fb7404-491e-459c-877d-2a8126c21e2e req-7f97e332-db23-4fce-baf6-496e532bcb19 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-vif-unplugged-9faebb20-c966-4250-b0f7-947a3a6efacf for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Instance destroyed successfully.
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lazy-loading 'resources' on Instance uuid e31123e5-1b35-4456-af70-e6b3c058dae1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-946530315',display_name='tempest-TestVolumeSwap-server-946530315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-946530315',id=9,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUKbZuZArZ70m9vIJF0+Xwy914Cvu9uHJYv60RFS3YIWGXIYM6dt0rtN2t/5jPirhRhoa8wsLIvNaFKh+jZ1UyEkBSapxbF3yyX4OVkXqEhey9LLZa0lQge6Z+nuEIGvw==',key_name='tempest-keypair-438753428',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cecaf1abaeeb43efb28629a65c00a7f3',ramdisk_id='',reservation_id='r-q8pfw80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1154616542',owner_user_name='tempest-TestVolumeSwap-1154616542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f58f2ef909547e28317c0986dae386b',uuid=e31123e5-1b35-4456-af70-e6b3c058dae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Converting VIF {"id": "9faebb20-c966-4250-b0f7-947a3a6efacf", "address": "fa:16:3e:08:a1:be", "network": {"id": "fd7c3606-54b1-4f15-a9ef-eff83c363925", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1862764956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecaf1abaeeb43efb28629a65c00a7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faebb20-c9", "ovs_interfaceid": "9faebb20-c966-4250-b0f7-947a3a6efacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:a1:be,bridge_name='br-int',has_traffic_filtering=True,id=9faebb20-c966-4250-b0f7-947a3a6efacf,network=Network(fd7c3606-54b1-4f15-a9ef-eff83c363925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faebb20-c9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG os_vif [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:a1:be,bridge_name='br-int',has_traffic_filtering=True,id=9faebb20-c966-4250-b0f7-947a3a6efacf,network=Network(fd7c3606-54b1-4f15-a9ef-eff83c363925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faebb20-c9') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9faebb20-c9, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bc34d4c-acdd-4d7b-b5b2-11df968e2bc5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:06 user nova-compute[75216]: INFO os_vif [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:a1:be,bridge_name='br-int',has_traffic_filtering=True,id=9faebb20-c966-4250-b0f7-947a3a6efacf,network=Network(fd7c3606-54b1-4f15-a9ef-eff83c363925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faebb20-c9')
Nov 02 04:49:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Deleting instance files /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1_del
Nov 02 04:49:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Deletion of /opt/stack/data/nova/instances/e31123e5-1b35-4456-af70-e6b3c058dae1_del complete
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:06 user nova-compute[75216]: INFO nova.compute.manager [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:49:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5c8d05f-421d-4e74-acee-329dd933e481 req-9ca049bf-f31f-4bb3-b7a6-e1b3b5c31264 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-vif-deleted-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:07 user nova-compute[75216]: INFO nova.compute.manager [req-b5c8d05f-421d-4e74-acee-329dd933e481 req-9ca049bf-f31f-4bb3-b7a6-e1b3b5c31264 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Neutron deleted interface 9faebb20-c966-4250-b0f7-947a3a6efacf; detaching it from the instance and deleting it from the info cache
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-b5c8d05f-421d-4e74-acee-329dd933e481 req-9ca049bf-f31f-4bb3-b7a6-e1b3b5c31264 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:07 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Took 0.71 seconds to deallocate network for instance.
Nov 02 04:49:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid 'e31123e5-1b35-4456-af70-e6b3c058dae1' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e31123e5-1b35-4456-af70-e6b3c058dae1' (instance-00000009)
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5c8d05f-421d-4e74-acee-329dd933e481 req-9ca049bf-f31f-4bb3-b7a6-e1b3b5c31264 service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Detach interface failed, port_id=9faebb20-c966-4250-b0f7-947a3a6efacf, reason: Instance e31123e5-1b35-4456-af70-e6b3c058dae1 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.637s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-81b8b676-b212-463b-ab12-caf6a6b5b2fd req-7ad051f9-e0aa-49f9-abc3-c9a816cb9f6e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received event network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81b8b676-b212-463b-ab12-caf6a6b5b2fd req-7ad051f9-e0aa-49f9-abc3-c9a816cb9f6e service nova] Acquiring lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81b8b676-b212-463b-ab12-caf6a6b5b2fd req-7ad051f9-e0aa-49f9-abc3-c9a816cb9f6e service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81b8b676-b212-463b-ab12-caf6a6b5b2fd req-7ad051f9-e0aa-49f9-abc3-c9a816cb9f6e service nova] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-81b8b676-b212-463b-ab12-caf6a6b5b2fd req-7ad051f9-e0aa-49f9-abc3-c9a816cb9f6e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] No waiting events found dispatching network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:07 user nova-compute[75216]: WARNING nova.compute.manager [req-81b8b676-b212-463b-ab12-caf6a6b5b2fd req-7ad051f9-e0aa-49f9-abc3-c9a816cb9f6e service nova] [instance: e31123e5-1b35-4456-af70-e6b3c058dae1] Received unexpected event network-vif-plugged-9faebb20-c966-4250-b0f7-947a3a6efacf for instance with vm_state deleted and task_state None.
Nov 02 04:49:07 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Deleted allocations for instance e31123e5-1b35-4456-af70-e6b3c058dae1
Nov 02 04:49:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-678b53a8-b50f-4ec9-bec7-d55c94a39309 tempest-TestVolumeSwap-1154616542 tempest-TestVolumeSwap-1154616542-project-member] Lock "e31123e5-1b35-4456-af70-e6b3c058dae1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.491s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:49:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7676MB free_disk=25.230670928955078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e7d2e9eb-f209-4d40-ba91-5145ae5256ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a61cce9f-24a3-4538-be2d-30b562825a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 04:49:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 04:49:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:49:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 04:49:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:49:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-changed-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Refreshing instance network info cache due to event network-changed-737e2805-edf4-49cd-997e-f93852c268d1. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:49:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] Acquiring lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:49:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] Acquired lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:49:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Refreshing network info cache for port 737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:20 user nova-compute[75216]: INFO nova.compute.manager [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Terminating instance
Nov 02 04:49:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updated VIF entry in instance network info cache for port 737e2805-edf4-49cd-997e-f93852c268d1. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updating instance_info_cache with network_info: [{"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b16a1af5-2130-4be0-85ca-3bb1d49754b5 req-bb541544-0f28-439d-a012-394de6dc6acb service nova] Releasing lock "refresh_cache-e7d2e9eb-f209-4d40-ba91-5145ae5256ce" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:49:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Instance destroyed successfully.
Nov 02 04:49:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'resources' on Instance uuid a2b40b8c-5b97-4bf8-adad-647ff27e2bab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1862184923',display_name='tempest-AttachVolumeNegativeTest-server-1862184923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1862184923',id=4,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECplp6jyJ3m/gYK2wMIBs60NAIzfVmpzZBsWHCdxWHuV3GM2NOYO3FtCL7xpSBQUZgqvhEbnTeYqblXcQKdFYrcOTbZ9abCIILP1CDM/seCTjRw8sHsFl2mW8Z8UVKcqg==',key_name='tempest-keypair-18798171',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-5p054bt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=a2b40b8c-5b97-4bf8-adad-647ff27e2bab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "address": "fa:16:3e:b7:95:58", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7dabe6f-d4", "ovs_interfaceid": "a7dabe6f-d443-44a3-9e79-445efa48e57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:95:58,bridge_name='br-int',has_traffic_filtering=True,id=a7dabe6f-d443-44a3-9e79-445efa48e57e,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dabe6f-d4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG os_vif [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:95:58,bridge_name='br-int',has_traffic_filtering=True,id=a7dabe6f-d443-44a3-9e79-445efa48e57e,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dabe6f-d4') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7dabe6f-d4, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: INFO nova.compute.manager [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Rebuilding instance
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fb84528-74b0-4f0f-886b-877f507421c3) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: INFO os_vif [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:95:58,bridge_name='br-int',has_traffic_filtering=True,id=a7dabe6f-d443-44a3-9e79-445efa48e57e,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7dabe6f-d4')
Nov 02 04:49:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Deleting instance files /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab_del
Nov 02 04:49:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Deletion of /opt/stack/data/nova/instances/a2b40b8c-5b97-4bf8-adad-647ff27e2bab_del complete
Nov 02 04:49:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:49:21 user nova-compute[75216]: INFO nova.compute.manager [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 02 04:49:21 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-vif-unplugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] No waiting events found dispatching network-vif-unplugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-vif-unplugged-a7dabe6f-d443-44a3-9e79-445efa48e57e for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Acquiring lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] No waiting events found dispatching network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:22 user nova-compute[75216]: WARNING nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received unexpected event network-vif-plugged-a7dabe6f-d443-44a3-9e79-445efa48e57e for instance with vm_state active and task_state deleting.
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-unplugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No waiting events found dispatching network-vif-unplugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:22 user nova-compute[75216]: WARNING nova.compute.manager [req-7f2883f1-13b9-48f5-992e-16ce3a99cd58 req-273fc1e2-66bc-4a29-86c7-4467f912ce27 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received unexpected event network-vif-unplugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with vm_state active and task_state rebuilding.
Nov 02 04:49:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance destroyed successfully.
Nov 02 04:49:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance destroyed successfully.
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548750406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-887008941',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikMoc+LjF47vbDkidZH2OP2JcfDYxU35Wr0fLVuf3xpHoPTwdOEtjII8qkbROyEovHT7tXE5H8ktlhKMgBrP7agimsJbCrj99IVLN7QhRVtQTlyVbrmLDd5mPkiSRl/Q==',key_name='tempest-keypair-1994893486',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3feded7f0e024aa2b09aa6a76f73f0c3',ramdisk_id='',reservation_id='r-lkidyuac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1935368242',owner_user_name='tempest-ServerActionsV293TestJSON-1935368242-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d62e71597ef4d2fac3eb798fac76357',uuid=e7d2e9eb-f209-4d40-ba91-5145ae5256ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converting VIF {"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_vif [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap737e2805-ed, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=605c0ed5-4931-47a0-a2b6-61d3ad0ba427) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:49:22 user nova-compute[75216]: INFO os_vif [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed')
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:49:22 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[add4381b-2332-4235-a43e-c3b255387aa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:49:22 user nova-compute[75216]: No targets found.
Nov 02 04:49:22 user nova-compute[75216]: iSNS:
Nov 02 04:49:22 user nova-compute[75216]: No targets found.
Nov 02 04:49:22 user nova-compute[75216]: STATIC:
Nov 02 04:49:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:49:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:22 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:49:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:22 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:49:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:22 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:22 user nova-compute[75216]: FIRMWARE:
Nov 02 04:49:22 user nova-compute[75216]: No targets found.
Nov 02 04:49:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:49:22 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:49:22 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[370b46ac-f4eb-4704-8d1c-2c6a63df8a81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[400f48e7-1331-4f76-b8b0-4273f9a66a52]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5d68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948'): ({'sdg'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Removing single pathed devices sdg {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a521d5-3307-47ce-bd62-dd976e6a3dbb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Took 1.04 seconds to deallocate network for instance.
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-54f516ff-d49e-4a08-b8e7-6a7baa3410c6 req-cd421560-8ecb-4193-9757-d282b6f6100f service nova] [instance: a2b40b8c-5b97-4bf8-adad-647ff27e2bab] Received event network-vif-deleted-a7dabe6f-d443-44a3-9e79-445efa48e57e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd7377a-3c8d-49b0-a4ad-340b16b4460e]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Flushing IO for device /dev/sdg {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad8bad4-132a-4a90-9eef-c0cade38f4de]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c052e-84c9-4d83-9691-ba4f0e174a96]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3503ebaf-ad457eb2baf750b9', '/dev/disk/by-id/scsi-26164343537656232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3503ebaf') {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d8d0a-60ee-43df-91df-77e1fe7a5a25]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3b3ee-4e84-4859-bd6f-e95d1e7ae7af]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e843410f-3082-42d3-96b3-4ea7f494cbe1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]
Nov 02 04:49:22 user nova-compute[75216]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.
Nov 02 04:49:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b7e23-2649-4439-aae4-df7f8ee2f530]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] <== disconnect_volume: return (403ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:49:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Deleting instance files /opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce_del
Nov 02 04:49:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Deletion of /opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce_del complete
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:22 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Deleted allocations for instance a2b40b8c-5b97-4bf8-adad-647ff27e2bab
Nov 02 04:49:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e7d2e9eb-f209-4d40-ba91-5145ae5256ce could not be found.
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:49:22 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aefd55-0f90-4d0b-bc5b-9653f26e426b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:49:22 user nova-compute[75216]: No targets found.
Nov 02 04:49:22 user nova-compute[75216]: iSNS:
Nov 02 04:49:22 user nova-compute[75216]: No targets found.
Nov 02 04:49:22 user nova-compute[75216]: STATIC:
Nov 02 04:49:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:49:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:22 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:49:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:22 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:22 user nova-compute[75216]: FIRMWARE:
Nov 02 04:49:22 user nova-compute[75216]: No targets found.
Nov 02 04:49:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:49:22 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:49:22 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b6237-9f3d-4db7-84be-53121c50ee9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f342c2-9443-45e5-a10c-d848df78a9fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:49:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec436d40>, {}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Disconnecting from: [] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] <== disconnect_volume: return (95ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:49:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:49:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e8297c3-af3d-43e2-9d02-683ace13b628 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "a2b40b8c-5b97-4bf8-adad-647ff27e2bab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.773s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Preparing to wait for external event volume-reimaged-8df56c1c-21c1-475a-90de-70a2e7a7c948 {{(pid=75216) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-38e6181d-ed37-4d1e-ac48-22fcd21f3f75 req-ce2f36a9-60ba-4534-a8df-2afc5a9e1721 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38e6181d-ed37-4d1e-ac48-22fcd21f3f75 req-ce2f36a9-60ba-4534-a8df-2afc5a9e1721 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38e6181d-ed37-4d1e-ac48-22fcd21f3f75 req-ce2f36a9-60ba-4534-a8df-2afc5a9e1721 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38e6181d-ed37-4d1e-ac48-22fcd21f3f75 req-ce2f36a9-60ba-4534-a8df-2afc5a9e1721 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-38e6181d-ed37-4d1e-ac48-22fcd21f3f75 req-ce2f36a9-60ba-4534-a8df-2afc5a9e1721 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No event matching network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 in dict_keys([('volume-reimaged', '8df56c1c-21c1-475a-90de-70a2e7a7c948')]) {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 02 04:49:24 user nova-compute[75216]: WARNING nova.compute.manager [req-38e6181d-ed37-4d1e-ac48-22fcd21f3f75 req-ce2f36a9-60ba-4534-a8df-2afc5a9e1721 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received unexpected event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with vm_state active and task_state rebuilding.
Nov 02 04:49:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:29 user nova-compute[75216]: INFO nova.compute.manager [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Detaching volume 190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:49:29 user nova-compute[75216]: INFO nova.virt.block_device [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Attempting to driver detach volume 190e3f9b-861b-4d12-a12f-e6c99f3fca12 from mountpoint /dev/vdb
Nov 02 04:49:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Attempting to detach device vdb from instance 5405f6de-5da9-475e-9647-7851ca87371d from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:49:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:49:29 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:49:29 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:49:29 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:49:29 user nova-compute[75216]:   <serial>190e3f9b-861b-4d12-a12f-e6c99f3fca12</serial>
Nov 02 04:49:29 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 04:49:29 user nova-compute[75216]: </disk>
Nov 02 04:49:29 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:49:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully detached device vdb from instance 5405f6de-5da9-475e-9647-7851ca87371d from the persistent domain config.
Nov 02 04:49:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5405f6de-5da9-475e-9647-7851ca87371d from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:49:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:49:29 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:49:29 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:49:29 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:49:29 user nova-compute[75216]:   <serial>190e3f9b-861b-4d12-a12f-e6c99f3fca12</serial>
Nov 02 04:49:29 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 04:49:29 user nova-compute[75216]: </disk>
Nov 02 04:49:29 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:49:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:49:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:49:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:49:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:49:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:49:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:49:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:45 user nova-compute[75216]: INFO nova.compute.manager [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Unrescuing
Nov 02 04:49:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:49:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:49:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating instance_info_cache with network_info: [{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'flavor' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-0de95a7b-d867-4e96-b9f4-c49f4444ebaf req-5dbed7ce-6aff-48a6-a31c-c2acf5a01e3a service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0de95a7b-d867-4e96-b9f4-c49f4444ebaf req-5dbed7ce-6aff-48a6-a31c-c2acf5a01e3a service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0de95a7b-d867-4e96-b9f4-c49f4444ebaf req-5dbed7ce-6aff-48a6-a31c-c2acf5a01e3a service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0de95a7b-d867-4e96-b9f4-c49f4444ebaf req-5dbed7ce-6aff-48a6-a31c-c2acf5a01e3a service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-0de95a7b-d867-4e96-b9f4-c49f4444ebaf req-5dbed7ce-6aff-48a6-a31c-c2acf5a01e3a service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:46 user nova-compute[75216]: WARNING nova.compute.manager [req-0de95a7b-d867-4e96-b9f4-c49f4444ebaf req-5dbed7ce-6aff-48a6-a31c-c2acf5a01e3a service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:49:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:46 user nova-compute[75216]: WARNING nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 3b055742-c605-41ab-bd40-1a777b8f4e39 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 096b87b4-307f-4bda-8ad6-f0b0925aae54 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid e7d2e9eb-f209-4d40-ba91-5145ae5256ce {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid a61cce9f-24a3-4538-be2d-30b562825a16 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "43182725-9f83-4afd-a243-49d838e7d811" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:46 user nova-compute[75216]: INFO nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 43182725-9f83-4afd-a243-49d838e7d811] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "43182725-9f83-4afd-a243-49d838e7d811" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:46 user nova-compute[75216]: INFO nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] During sync_power_state the instance has a pending task (rebuilding). Skip.
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance destroyed successfully.
Nov 02 04:49:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-44b9fb90-efe0-446a-94df-1fe9c5d5d410 req-182865eb-79f1-4cf6-b224-2c96bdfee75b service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44b9fb90-efe0-446a-94df-1fe9c5d5d410 req-182865eb-79f1-4cf6-b224-2c96bdfee75b service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44b9fb90-efe0-446a-94df-1fe9c5d5d410 req-182865eb-79f1-4cf6-b224-2c96bdfee75b service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44b9fb90-efe0-446a-94df-1fe9c5d5d410 req-182865eb-79f1-4cf6-b224-2c96bdfee75b service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-44b9fb90-efe0-446a-94df-1fe9c5d5d410 req-182865eb-79f1-4cf6-b224-2c96bdfee75b service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:48 user nova-compute[75216]: WARNING nova.compute.manager [req-44b9fb90-efe0-446a-94df-1fe9c5d5d410 req-182865eb-79f1-4cf6-b224-2c96bdfee75b service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:49:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5405f6de-5da9-475e-9647-7851ca87371d is timed out.
Nov 02 04:49:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully detached device vdb from instance 5405f6de-5da9-475e-9647-7851ca87371d from the live domain config.
Nov 02 04:49:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JztYWQgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:49:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[502cd354-7514-476b-b5f3-58e913b5f1ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:49:49 user nova-compute[75216]: No targets found.
Nov 02 04:49:49 user nova-compute[75216]: iSNS:
Nov 02 04:49:49 user nova-compute[75216]: No targets found.
Nov 02 04:49:49 user nova-compute[75216]: STATIC:
Nov 02 04:49:49 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:49:49 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:49 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:49 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:49:49 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:49 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:49 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12
Nov 02 04:49:49 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:49:49 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:49:49 user nova-compute[75216]: FIRMWARE:
Nov 02 04:49:49 user nova-compute[75216]: No targets found.
Nov 02 04:49:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:49:49 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:49:49 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82172755-26f9-42f7-94eb-4800a7acd1df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7502d280-4f45-45e5-987b-dd7cc0c4f141]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:49:49 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:49:49 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:49:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:49:49 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 (non-flash)
Nov 02 04:49:49 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:49:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5d6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d2b24c-e40f-4667-b28a-4624cd43d0f6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a16e67-54b0-431b-ad74-4efa6b9207b5]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4986816-abbe-4a9a-b631-2fe0cfdeab51]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b55d62-5e6a-467d-900a-524f9f77d85c]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14ca8a1-b9b0-44f3-85be-4b609fa95ff0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30412ce4-1762-4bbf-8d90-b18ba598a699]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260]
Nov 02 04:49:49 user nova-compute[75216]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12, portal: 172.16.0.220,3260] successful.
Nov 02 04:49:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e3f9b-861b-4d12-a12f-e6c99f3fca12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d593b-35b9-48e5-a91d-fffe263b373c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== disconnect_volume: return (353ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:49:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:50 user nova-compute[75216]: WARNING nova.compute.manager [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:49:50 user nova-compute[75216]: WARNING nova.compute.manager [req-433cbf36-de1e-464f-ac66-7a7cdd7b1029 req-4c749de4-a293-49a2-b913-740ec7304d3f service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:49:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9c7cfa33-46f3-435d-af06-9c69e94e69e2 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 req-21c8296b-6321-4c05-b65f-80bb9a196f78 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event volume-reimaged-8df56c1c-21c1-475a-90de-70a2e7a7c948 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 req-21c8296b-6321-4c05-b65f-80bb9a196f78 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 req-21c8296b-6321-4c05-b65f-80bb9a196f78 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 req-21c8296b-6321-4c05-b65f-80bb9a196f78 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 req-21c8296b-6321-4c05-b65f-80bb9a196f78 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Processing event volume-reimaged-8df56c1c-21c1-475a-90de-70a2e7a7c948 {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance event wait completed in 32 seconds for volume-reimaged {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:49:56 user nova-compute[75216]: INFO nova.virt.block_device [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Booting with volume 8df56c1c-21c1-475a-90de-70a2e7a7c948 at /dev/vda
Nov 02 04:49:56 user nova-compute[75216]: DEBUG os_brick.utils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[218c43b3-7bec-407c-823f-56860c19eda2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[635cf1bb-a19d-4d26-8de3-5ff7ba835806]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[215e7dfc-65e2-40c8-abbd-4cb12504d696]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b067d94-cc64-414b-9b66-096f15631388]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:49:56 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:49:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed19d9-7c80-4082-ab94-e48310cfc34d]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG os_brick.utils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:49:56 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updating existing volume attachment record: 81456745-239a-46c9-bce6-1bf96d38c89a {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:49:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:49:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:03 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fcd1dc22-5d55-4286-a472-32dbaa220e64 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.888s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.226s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a139b4b-4523-4bf7-b198-5a6408d7be1e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a139b4b-4523-4bf7-b198-5a6408d7be1e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a139b4b-4523-4bf7-b198-5a6408d7be1e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:50:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a139b4b-4523-4bf7-b198-5a6408d7be1e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75216) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 04:50:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6a139b4b-4523-4bf7-b198-5a6408d7be1e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance destroyed successfully.
Nov 02 04:50:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a139b4b-4523-4bf7-b198-5a6408d7be1e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a139b4b-4523-4bf7-b198-5a6408d7be1e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.949s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:50:06 user nova-compute[75216]: INFO nova.compute.claims [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Claim successful on node user
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:50:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:50:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG nova.policy [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e06c15a638245d2825317e30721ebd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b5ff67267c443b81b9472b5d5560ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:50:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Creating image(s)
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "/opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "/opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "/opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d3a5bd1-48c7-4b90-bea3-f31a5d6311a9 req-080281bd-8147-45f2-b8f2-f28d99480958 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d3a5bd1-48c7-4b90-bea3-f31a5d6311a9 req-080281bd-8147-45f2-b8f2-f28d99480958 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d3a5bd1-48c7-4b90-bea3-f31a5d6311a9 req-080281bd-8147-45f2-b8f2-f28d99480958 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d3a5bd1-48c7-4b90-bea3-f31a5d6311a9 req-080281bd-8147-45f2-b8f2-f28d99480958 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d3a5bd1-48c7-4b90-bea3-f31a5d6311a9 req-080281bd-8147-45f2-b8f2-f28d99480958 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:08 user nova-compute[75216]: WARNING nova.compute.manager [req-4d3a5bd1-48c7-4b90-bea3-f31a5d6311a9 req-080281bd-8147-45f2-b8f2-f28d99480958 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state stopped and task_state None.
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.607s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8331MB free_disk=25.270854949951172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk 1073741824" returned: 0 in 0.069s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.682s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Successfully created port: 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e7d2e9eb-f209-4d40-ba91-5145ae5256ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a61cce9f-24a3-4538-be2d-30b562825a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.255s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Cannot resize image /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Ensure instance console log exists: /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:50:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Successfully updated port: 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquired lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updating instance_info_cache with network_info: [{"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Releasing lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Instance network_info: |[{"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Start _get_guest_xml network_info=[{"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:50:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-718097847',display_name='tempest-TestStampPattern-server-718097847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-718097847',id=15,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsRzP3Sg+sJdhvi68MNNzT62rX+Rvtkulq7b2aqFAXRvz/PCDywk8i0/3Qn3hw8DO0i8lgHEo5/PcGZcK4FS6lQGDpD4OwaBWQCg1f0tC4Nct4Wx2de+2XNa4rN9Rx48A==',key_name='tempest-TestStampPattern-2044657716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6b5ff67267c443b81b9472b5d5560ab',ramdisk_id='',reservation_id='r-0lmlv400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-774067185',owner_user_name='tempest-TestStampPattern-774067185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:50:07Z,user_data=None,user_id='2e06c15a638245d2825317e30721ebd1',uuid=5da51a4a-9605-4c02-b3cb-367fafba296f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converting VIF {"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:d4:fc,bridge_name='br-int',has_traffic_filtering=True,id=8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7ca30-f6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'pci_devices' on Instance uuid 5da51a4a-9605-4c02-b3cb-367fafba296f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:50:09 user nova-compute[75216]:   <uuid>5da51a4a-9605-4c02-b3cb-367fafba296f</uuid>
Nov 02 04:50:09 user nova-compute[75216]:   <name>instance-0000000f</name>
Nov 02 04:50:09 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:50:09 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:50:09 user nova-compute[75216]:   <metadata>
Nov 02 04:50:09 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:50:09 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:50:09 user nova-compute[75216]:       <nova:name>tempest-TestStampPattern-server-718097847</nova:name>
Nov 02 04:50:09 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:50:09</nova:creationTime>
Nov 02 04:50:09 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:50:09 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:50:09 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:50:09 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:50:09 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:50:09 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:50:09 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:50:09 user nova-compute[75216]:       <nova:owner>
Nov 02 04:50:09 user nova-compute[75216]:         <nova:user uuid="2e06c15a638245d2825317e30721ebd1">tempest-TestStampPattern-774067185-project-member</nova:user>
Nov 02 04:50:09 user nova-compute[75216]:         <nova:project uuid="d6b5ff67267c443b81b9472b5d5560ab">tempest-TestStampPattern-774067185</nova:project>
Nov 02 04:50:09 user nova-compute[75216]:       </nova:owner>
Nov 02 04:50:09 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:50:09 user nova-compute[75216]:       <nova:ports>
Nov 02 04:50:09 user nova-compute[75216]:         <nova:port uuid="8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58">
Nov 02 04:50:09 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 04:50:09 user nova-compute[75216]:         </nova:port>
Nov 02 04:50:09 user nova-compute[75216]:       </nova:ports>
Nov 02 04:50:09 user nova-compute[75216]:     </nova:instance>
Nov 02 04:50:09 user nova-compute[75216]:   </metadata>
Nov 02 04:50:09 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:50:09 user nova-compute[75216]:     <system>
Nov 02 04:50:09 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:50:09 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:50:09 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:50:09 user nova-compute[75216]:       <entry name="serial">5da51a4a-9605-4c02-b3cb-367fafba296f</entry>
Nov 02 04:50:09 user nova-compute[75216]:       <entry name="uuid">5da51a4a-9605-4c02-b3cb-367fafba296f</entry>
Nov 02 04:50:09 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:50:09 user nova-compute[75216]:     </system>
Nov 02 04:50:09 user nova-compute[75216]:   </sysinfo>
Nov 02 04:50:09 user nova-compute[75216]:   <os>
Nov 02 04:50:09 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:50:09 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:50:09 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:50:09 user nova-compute[75216]:   </os>
Nov 02 04:50:09 user nova-compute[75216]:   <features>
Nov 02 04:50:09 user nova-compute[75216]:     <acpi/>
Nov 02 04:50:09 user nova-compute[75216]:     <apic/>
Nov 02 04:50:09 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:50:09 user nova-compute[75216]:   </features>
Nov 02 04:50:09 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:50:09 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:50:09 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:50:09 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:50:09 user nova-compute[75216]:   </clock>
Nov 02 04:50:09 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:50:09 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:50:09 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:50:09 user nova-compute[75216]:   </cpu>
Nov 02 04:50:09 user nova-compute[75216]:   <devices>
Nov 02 04:50:09 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:50:09 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:50:09 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk"/>
Nov 02 04:50:09 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:50:09 user nova-compute[75216]:     </disk>
Nov 02 04:50:09 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:50:09 user nova-compute[75216]:       <mac address="fa:16:3e:14:d4:fc"/>
Nov 02 04:50:09 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:09 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:50:09 user nova-compute[75216]:       <target dev="tap8ee7ca30-f6"/>
Nov 02 04:50:09 user nova-compute[75216]:     </interface>
Nov 02 04:50:09 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:50:09 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/console.log" append="off"/>
Nov 02 04:50:09 user nova-compute[75216]:     </serial>
Nov 02 04:50:09 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:50:09 user nova-compute[75216]:     <video>
Nov 02 04:50:09 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:09 user nova-compute[75216]:     </video>
Nov 02 04:50:09 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:50:09 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:50:09 user nova-compute[75216]:     </rng>
Nov 02 04:50:09 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:50:09 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:50:09 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:50:09 user nova-compute[75216]:     </memballoon>
Nov 02 04:50:09 user nova-compute[75216]:   </devices>
Nov 02 04:50:09 user nova-compute[75216]: </domain>
Nov 02 04:50:09 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-718097847',display_name='tempest-TestStampPattern-server-718097847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-718097847',id=15,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsRzP3Sg+sJdhvi68MNNzT62rX+Rvtkulq7b2aqFAXRvz/PCDywk8i0/3Qn3hw8DO0i8lgHEo5/PcGZcK4FS6lQGDpD4OwaBWQCg1f0tC4Nct4Wx2de+2XNa4rN9Rx48A==',key_name='tempest-TestStampPattern-2044657716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6b5ff67267c443b81b9472b5d5560ab',ramdisk_id='',reservation_id='r-0lmlv400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-774067185',owner_user_name='tempest-TestStampPattern-774067185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:50:07Z,user_data=None,user_id='2e06c15a638245d2825317e30721ebd1',uuid=5da51a4a-9605-4c02-b3cb-367fafba296f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converting VIF {"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:d4:fc,bridge_name='br-int',has_traffic_filtering=True,id=8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7ca30-f6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG os_vif [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:d4:fc,bridge_name='br-int',has_traffic_filtering=True,id=8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7ca30-f6') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f55dd45-eca4-5531-babc-31966e0cb040', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ee7ca30-f6, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ee7ca30-f6, col_values=(('qos', UUID('2fea0644-cfdb-48cc-91a1-992611e493c5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ee7ca30-f6, col_values=(('external_ids', {'iface-id': '8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:d4:fc', 'vm-uuid': '5da51a4a-9605-4c02-b3cb-367fafba296f'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:09 user nova-compute[75216]: INFO os_vif [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:d4:fc,bridge_name='br-int',has_traffic_filtering=True,id=8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7ca30-f6')
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No VIF found with MAC fa:16:3e:14:d4:fc, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:09 user nova-compute[75216]: WARNING nova.compute.manager [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state stopped and task_state None.
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-changed-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Refreshing instance network info cache due to event network-changed-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] Acquiring lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] Acquired lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Refreshing network info cache for port 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updated VIF entry in instance network info cache for port 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updating instance_info_cache with network_info: [{"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9621c276-3bde-4c2e-a235-d3e37cbb7d81 req-a053cec1-9cf7-4ed8-8384-2d66e2dabdb2 service nova] Releasing lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Skipping network cache update for instance because it is Building. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:50:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 3b055742-c605-41ab-bd40-1a777b8f4e39 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updating instance_info_cache with network_info: [{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-de1dae5c-2388-45cc-86a8-2237c8fc55cc req-4e301319-537b-4695-8ba1-210c9e2280f2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-de1dae5c-2388-45cc-86a8-2237c8fc55cc req-4e301319-537b-4695-8ba1-210c9e2280f2 service nova] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-de1dae5c-2388-45cc-86a8-2237c8fc55cc req-4e301319-537b-4695-8ba1-210c9e2280f2 service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-de1dae5c-2388-45cc-86a8-2237c8fc55cc req-4e301319-537b-4695-8ba1-210c9e2280f2 service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-de1dae5c-2388-45cc-86a8-2237c8fc55cc req-4e301319-537b-4695-8ba1-210c9e2280f2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] No waiting events found dispatching network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:11 user nova-compute[75216]: WARNING nova.compute.manager [req-de1dae5c-2388-45cc-86a8-2237c8fc55cc req-4e301319-537b-4695-8ba1-210c9e2280f2 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received unexpected event network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 for instance with vm_state building and task_state spawning.
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:12 user nova-compute[75216]: INFO nova.compute.manager [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Terminating instance
Nov 02 04:50:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Instance destroyed successfully.
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lazy-loading 'resources' on Instance uuid 096b87b4-307f-4bda-8ad6-f0b0925aae54 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2032104718',display_name='tempest-ServerStableDeviceRescueTest-server-2032104718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2032104718',id=5,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMxTLfBZHOz8z7+NKS8lOHqQy7CmLqsWOIx/2iekQeTLJBJ8iUUjqXitlf1SSCgHurhOepyeYrrdl2x3UoJh7BsmLBE8c21PfEBFMl/HM4rU2OevWTtDBumlimhmDKHtw==',key_name='tempest-keypair-169616001',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f35683efd2824c0c9f120badf288862f',ramdisk_id='',reservation_id='r-i7yvvq30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1994902459',owner_user_name='tempest-ServerStableDeviceRescueTest-1994902459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8929863fd45d4913acd8e30f664344c7',uuid=096b87b4-307f-4bda-8ad6-f0b0925aae54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Converting VIF {"id": "71df5a7f-f774-428f-8f64-138cb2f78152", "address": "fa:16:3e:b3:b3:00", "network": {"id": "734db476-6358-45cd-8739-5acf10fa631c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-456303169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f35683efd2824c0c9f120badf288862f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71df5a7f-f7", "ovs_interfaceid": "71df5a7f-f774-428f-8f64-138cb2f78152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b3:00,bridge_name='br-int',has_traffic_filtering=True,id=71df5a7f-f774-428f-8f64-138cb2f78152,network=Network(734db476-6358-45cd-8739-5acf10fa631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71df5a7f-f7') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG os_vif [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b3:00,bridge_name='br-int',has_traffic_filtering=True,id=71df5a7f-f774-428f-8f64-138cb2f78152,network=Network(734db476-6358-45cd-8739-5acf10fa631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71df5a7f-f7') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71df5a7f-f7, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7be64dc7-0019-4b74-b908-7d0b7c7af5b8) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:13 user nova-compute[75216]: INFO os_vif [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b3:00,bridge_name='br-int',has_traffic_filtering=True,id=71df5a7f-f774-428f-8f64-138cb2f78152,network=Network(734db476-6358-45cd-8739-5acf10fa631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71df5a7f-f7')
Nov 02 04:50:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Deleting instance files /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54_del
Nov 02 04:50:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Deletion of /opt/stack/data/nova/instances/096b87b4-307f-4bda-8ad6-f0b0925aae54_del complete
Nov 02 04:50:13 user nova-compute[75216]: INFO nova.compute.manager [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] No waiting events found dispatching network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:13 user nova-compute[75216]: WARNING nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received unexpected event network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 for instance with vm_state building and task_state spawning.
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-vif-unplugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] No waiting events found dispatching network-vif-unplugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-vif-unplugged-71df5a7f-f774-428f-8f64-138cb2f78152 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Acquiring lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] No waiting events found dispatching network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:13 user nova-compute[75216]: WARNING nova.compute.manager [req-56b9f607-72fe-4767-8fde-6644fa11081d req-217f25e4-0cf8-4778-8369-4022c0dc231a service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received unexpected event network-vif-plugged-71df5a7f-f774-428f-8f64-138cb2f78152 for instance with vm_state active and task_state deleting.
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:50:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Instance spawned successfully.
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:14 user nova-compute[75216]: INFO nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 02 04:50:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:50:14 user nova-compute[75216]: INFO nova.compute.manager [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Took 7.75 seconds to build instance.
Nov 02 04:50:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5696c8f8-8a39-47d5-82a3-afba8180db35 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.863s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:14 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:14 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Took 1.41 seconds to deallocate network for instance.
Nov 02 04:50:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-32074f58-3d3f-4fe3-83a3-b4f8ed8614f6 req-56f716aa-441f-424a-a3ff-047a926d6e51 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Received event network-vif-deleted-71df5a7f-f774-428f-8f64-138cb2f78152 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:14 user nova-compute[75216]: INFO nova.compute.manager [req-32074f58-3d3f-4fe3-83a3-b4f8ed8614f6 req-56f716aa-441f-424a-a3ff-047a926d6e51 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Neutron deleted interface 71df5a7f-f774-428f-8f64-138cb2f78152; detaching it from the instance and deleting it from the info cache
Nov 02 04:50:14 user nova-compute[75216]: DEBUG nova.network.neutron [req-32074f58-3d3f-4fe3-83a3-b4f8ed8614f6 req-56f716aa-441f-424a-a3ff-047a926d6e51 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-32074f58-3d3f-4fe3-83a3-b4f8ed8614f6 req-56f716aa-441f-424a-a3ff-047a926d6e51 service nova] [instance: 096b87b4-307f-4bda-8ad6-f0b0925aae54] Detach interface failed, port_id=71df5a7f-f774-428f-8f64-138cb2f78152, reason: Instance 096b87b4-307f-4bda-8ad6-f0b0925aae54 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:50:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:15 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Deleted allocations for instance 096b87b4-307f-4bda-8ad6-f0b0925aae54
Nov 02 04:50:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c97bc5d-2ad9-4c07-ac98-a3b7b9620fca tempest-ServerStableDeviceRescueTest-1994902459 tempest-ServerStableDeviceRescueTest-1994902459-project-member] Lock "096b87b4-307f-4bda-8ad6-f0b0925aae54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:50:15 user nova-compute[75216]: INFO nova.compute.claims [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Claim successful on node user
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:50:16 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.policy [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43528060361f4924b8a858bdd2e731cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01690c91146afa3833bea67f8157f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:50:16 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Creating image(s)
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk 1073741824" returned: 0 in 0.061s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Successfully created port: 40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.243s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Cannot resize image /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Ensure instance console log exists: /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Successfully updated port: 40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquired lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-changed-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Refreshing instance network info cache due to event network-changed-40399418-dec4-45aa-9edd-b4239ee6a3ae. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] Acquiring lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Updating instance_info_cache with network_info: [{"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Releasing lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Instance network_info: |[{"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] Acquired lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Refreshing network info cache for port 40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Start _get_guest_xml network_info=[{"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:50:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947082500',display_name='tempest-AttachVolumeNegativeTest-server-947082500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947082500',id=16,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPng9qTHmMn6lBAGTHBFbjv8LYvQpTkreNAXlJgwkAwcKrDv/3I7RJyfinIyPEMited9yt0E4fJxS/WZdyecJ8r9LWL9Ql2TOC1/0jIVGWTGxnWN3VBdBPeyOwJBeG1ObQ==',key_name='tempest-keypair-543058139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-ukirvqsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:50:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=fb54dbed-eb59-4714-8cbe-da5cc5fe8b21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:e1:ba,bridge_name='br-int',has_traffic_filtering=True,id=40399418-dec4-45aa-9edd-b4239ee6a3ae,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40399418-de') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'pci_devices' on Instance uuid fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:50:18 user nova-compute[75216]:   <uuid>fb54dbed-eb59-4714-8cbe-da5cc5fe8b21</uuid>
Nov 02 04:50:18 user nova-compute[75216]:   <name>instance-00000010</name>
Nov 02 04:50:18 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:50:18 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:50:18 user nova-compute[75216]:   <metadata>
Nov 02 04:50:18 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:50:18 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:50:18 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-947082500</nova:name>
Nov 02 04:50:18 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:50:18</nova:creationTime>
Nov 02 04:50:18 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:50:18 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:50:18 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:50:18 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:50:18 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:50:18 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:50:18 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:50:18 user nova-compute[75216]:       <nova:owner>
Nov 02 04:50:18 user nova-compute[75216]:         <nova:user uuid="43528060361f4924b8a858bdd2e731cc">tempest-AttachVolumeNegativeTest-1766043636-project-member</nova:user>
Nov 02 04:50:18 user nova-compute[75216]:         <nova:project uuid="e1c01690c91146afa3833bea67f8157f">tempest-AttachVolumeNegativeTest-1766043636</nova:project>
Nov 02 04:50:18 user nova-compute[75216]:       </nova:owner>
Nov 02 04:50:18 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:50:18 user nova-compute[75216]:       <nova:ports>
Nov 02 04:50:18 user nova-compute[75216]:         <nova:port uuid="40399418-dec4-45aa-9edd-b4239ee6a3ae">
Nov 02 04:50:18 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:50:18 user nova-compute[75216]:         </nova:port>
Nov 02 04:50:18 user nova-compute[75216]:       </nova:ports>
Nov 02 04:50:18 user nova-compute[75216]:     </nova:instance>
Nov 02 04:50:18 user nova-compute[75216]:   </metadata>
Nov 02 04:50:18 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:50:18 user nova-compute[75216]:     <system>
Nov 02 04:50:18 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:50:18 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:50:18 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:50:18 user nova-compute[75216]:       <entry name="serial">fb54dbed-eb59-4714-8cbe-da5cc5fe8b21</entry>
Nov 02 04:50:18 user nova-compute[75216]:       <entry name="uuid">fb54dbed-eb59-4714-8cbe-da5cc5fe8b21</entry>
Nov 02 04:50:18 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:50:18 user nova-compute[75216]:     </system>
Nov 02 04:50:18 user nova-compute[75216]:   </sysinfo>
Nov 02 04:50:18 user nova-compute[75216]:   <os>
Nov 02 04:50:18 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:50:18 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:50:18 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:50:18 user nova-compute[75216]:   </os>
Nov 02 04:50:18 user nova-compute[75216]:   <features>
Nov 02 04:50:18 user nova-compute[75216]:     <acpi/>
Nov 02 04:50:18 user nova-compute[75216]:     <apic/>
Nov 02 04:50:18 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:50:18 user nova-compute[75216]:   </features>
Nov 02 04:50:18 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:50:18 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:50:18 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:50:18 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:50:18 user nova-compute[75216]:   </clock>
Nov 02 04:50:18 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:50:18 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:50:18 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:50:18 user nova-compute[75216]:   </cpu>
Nov 02 04:50:18 user nova-compute[75216]:   <devices>
Nov 02 04:50:18 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:50:18 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:50:18 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk"/>
Nov 02 04:50:18 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:50:18 user nova-compute[75216]:     </disk>
Nov 02 04:50:18 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:50:18 user nova-compute[75216]:       <mac address="fa:16:3e:23:e1:ba"/>
Nov 02 04:50:18 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:18 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:50:18 user nova-compute[75216]:       <target dev="tap40399418-de"/>
Nov 02 04:50:18 user nova-compute[75216]:     </interface>
Nov 02 04:50:18 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:50:18 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/console.log" append="off"/>
Nov 02 04:50:18 user nova-compute[75216]:     </serial>
Nov 02 04:50:18 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:50:18 user nova-compute[75216]:     <video>
Nov 02 04:50:18 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:18 user nova-compute[75216]:     </video>
Nov 02 04:50:18 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:50:18 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:50:18 user nova-compute[75216]:     </rng>
Nov 02 04:50:18 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:50:18 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:50:18 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:50:18 user nova-compute[75216]:     </memballoon>
Nov 02 04:50:18 user nova-compute[75216]:   </devices>
Nov 02 04:50:18 user nova-compute[75216]: </domain>
Nov 02 04:50:18 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947082500',display_name='tempest-AttachVolumeNegativeTest-server-947082500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947082500',id=16,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPng9qTHmMn6lBAGTHBFbjv8LYvQpTkreNAXlJgwkAwcKrDv/3I7RJyfinIyPEMited9yt0E4fJxS/WZdyecJ8r9LWL9Ql2TOC1/0jIVGWTGxnWN3VBdBPeyOwJBeG1ObQ==',key_name='tempest-keypair-543058139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-ukirvqsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:50:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=fb54dbed-eb59-4714-8cbe-da5cc5fe8b21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:e1:ba,bridge_name='br-int',has_traffic_filtering=True,id=40399418-dec4-45aa-9edd-b4239ee6a3ae,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40399418-de') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG os_vif [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:e1:ba,bridge_name='br-int',has_traffic_filtering=True,id=40399418-dec4-45aa-9edd-b4239ee6a3ae,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40399418-de') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed108ff8-717c-595a-9f23-f80707748624', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40399418-de, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40399418-de, col_values=(('qos', UUID('8a3c386c-06e2-4d3f-8ba1-7c9445358830')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40399418-de, col_values=(('external_ids', {'iface-id': '40399418-dec4-45aa-9edd-b4239ee6a3ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:e1:ba', 'vm-uuid': 'fb54dbed-eb59-4714-8cbe-da5cc5fe8b21'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:18 user nova-compute[75216]: INFO os_vif [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:e1:ba,bridge_name='br-int',has_traffic_filtering=True,id=40399418-dec4-45aa-9edd-b4239ee6a3ae,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40399418-de')
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No VIF found with MAC fa:16:3e:23:e1:ba, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Updated VIF entry in instance network info cache for port 40399418-dec4-45aa-9edd-b4239ee6a3ae. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Updating instance_info_cache with network_info: [{"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9980dd84-27ea-436d-ad81-ae241eb3ecef req-5b2c7995-b7e7-45f2-aeb3-4231e4905e51 service nova] Releasing lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:50:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Creating image(s)
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Ensure instance console log exists: /opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Start _get_guest_xml network_info=[{"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '81456745-239a-46c9-bce6-1bf96d38c89a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7d2e9eb-f209-4d40-ba91-5145ae5256ce', 'attached_at': '', 'detached_at': '', 'volume_id': '8df56c1c-21c1-475a-90de-70a2e7a7c948', 'serial': '8df56c1c-21c1-475a-90de-70a2e7a7c948'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:50:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 04:50:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7d2e9eb-f209-4d40-ba91-5145ae5256ce {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:50:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:50:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:50:19 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a2d9b6-5d7b-4698-b965-361ca628df7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:50:19 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ce9e49-3dcf-4303-8a07-f638420f8f5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948] added
Nov 02 04:50:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a501ae2f-386b-4bdf-9eed-0579b9936459]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef3bac6-054a-437d-aead-929516c36cde]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCSBUbhu {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCSBUbhu" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5d3df1-8670-4e5b-b486-db34d399b2f7]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCSBUbhu'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c142893-d2ea-495c-b30a-e0e89e881ce9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e0fd45-9f55-49b9-b464-ef140c48918d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:50:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:50:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f07e289-023e-4ef9-a2dd-f803e5acc3b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]
Nov 02 04:50:19 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.
Nov 02 04:50:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aae482-44e9-4658-9b2a-e6b1ae5a5eb0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a4a1f-f2a9-4d0c-9663-f22dc76981e0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:50:19 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:50:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:50:19 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:50:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5f68b-6a8a-4c81-89c4-3768333a65b0]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-214ca880-00c5-4cd7-ab2e-1aa3e6a76e8e req-ab48ea60-6dba-43f0-a693-a395e20974f1 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-214ca880-00c5-4cd7-ab2e-1aa3e6a76e8e req-ab48ea60-6dba-43f0-a693-a395e20974f1 service nova] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-214ca880-00c5-4cd7-ab2e-1aa3e6a76e8e req-ab48ea60-6dba-43f0-a693-a395e20974f1 service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-214ca880-00c5-4cd7-ab2e-1aa3e6a76e8e req-ab48ea60-6dba-43f0-a693-a395e20974f1 service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-214ca880-00c5-4cd7-ab2e-1aa3e6a76e8e req-ab48ea60-6dba-43f0-a693-a395e20974f1 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] No waiting events found dispatching network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:20 user nova-compute[75216]: WARNING nova.compute.manager [req-214ca880-00c5-4cd7-ab2e-1aa3e6a76e8e req-ab48ea60-6dba-43f0-a693-a395e20974f1 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received unexpected event network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae for instance with vm_state building and task_state spawning.
Nov 02 04:50:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26164343537656232', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:50:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164343537656232', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548750406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-887008941',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikMoc+LjF47vbDkidZH2OP2JcfDYxU35Wr0fLVuf3xpHoPTwdOEtjII8qkbROyEovHT7tXE5H8ktlhKMgBrP7agimsJbCrj99IVLN7QhRVtQTlyVbrmLDd5mPkiSRl/Q==',key_name='tempest-keypair-1994893486',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3feded7f0e024aa2b09aa6a76f73f0c3',ramdisk_id='',reservation_id='r-lkidyuac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1935368242',owner_user_name='tempest-ServerActionsV293TestJSON-1935368242-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d62e71597ef4d2fac3eb798fac76357',uuid=e7d2e9eb-f209-4d40-ba91-5145ae5256ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converting VIF {"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:50:21 user nova-compute[75216]:   <uuid>e7d2e9eb-f209-4d40-ba91-5145ae5256ce</uuid>
Nov 02 04:50:21 user nova-compute[75216]:   <name>instance-0000000d</name>
Nov 02 04:50:21 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:50:21 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:50:21 user nova-compute[75216]:   <metadata>
Nov 02 04:50:21 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:50:21 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:50:21 user nova-compute[75216]:       <nova:name>tempest-ServerActionsV293TestJSON-server-548750406</nova:name>
Nov 02 04:50:21 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:50:19</nova:creationTime>
Nov 02 04:50:21 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:50:21 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:50:21 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:50:21 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:50:21 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:50:21 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:50:21 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:50:21 user nova-compute[75216]:       <nova:owner>
Nov 02 04:50:21 user nova-compute[75216]:         <nova:user uuid="3d62e71597ef4d2fac3eb798fac76357">tempest-ServerActionsV293TestJSON-1935368242-project-member</nova:user>
Nov 02 04:50:21 user nova-compute[75216]:         <nova:project uuid="3feded7f0e024aa2b09aa6a76f73f0c3">tempest-ServerActionsV293TestJSON-1935368242</nova:project>
Nov 02 04:50:21 user nova-compute[75216]:       </nova:owner>
Nov 02 04:50:21 user nova-compute[75216]:       <nova:ports>
Nov 02 04:50:21 user nova-compute[75216]:         <nova:port uuid="737e2805-edf4-49cd-997e-f93852c268d1">
Nov 02 04:50:21 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:50:21 user nova-compute[75216]:         </nova:port>
Nov 02 04:50:21 user nova-compute[75216]:       </nova:ports>
Nov 02 04:50:21 user nova-compute[75216]:     </nova:instance>
Nov 02 04:50:21 user nova-compute[75216]:   </metadata>
Nov 02 04:50:21 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:50:21 user nova-compute[75216]:     <system>
Nov 02 04:50:21 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:50:21 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:50:21 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:50:21 user nova-compute[75216]:       <entry name="serial">e7d2e9eb-f209-4d40-ba91-5145ae5256ce</entry>
Nov 02 04:50:21 user nova-compute[75216]:       <entry name="uuid">e7d2e9eb-f209-4d40-ba91-5145ae5256ce</entry>
Nov 02 04:50:21 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:50:21 user nova-compute[75216]:     </system>
Nov 02 04:50:21 user nova-compute[75216]:   </sysinfo>
Nov 02 04:50:21 user nova-compute[75216]:   <os>
Nov 02 04:50:21 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:50:21 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:50:21 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:50:21 user nova-compute[75216]:   </os>
Nov 02 04:50:21 user nova-compute[75216]:   <features>
Nov 02 04:50:21 user nova-compute[75216]:     <acpi/>
Nov 02 04:50:21 user nova-compute[75216]:     <apic/>
Nov 02 04:50:21 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:50:21 user nova-compute[75216]:   </features>
Nov 02 04:50:21 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:50:21 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:50:21 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:50:21 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:50:21 user nova-compute[75216]:   </clock>
Nov 02 04:50:21 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:50:21 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:50:21 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:50:21 user nova-compute[75216]:   </cpu>
Nov 02 04:50:21 user nova-compute[75216]:   <devices>
Nov 02 04:50:21 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:50:21 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:50:21 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 04:50:21 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:50:21 user nova-compute[75216]:       <serial>8df56c1c-21c1-475a-90de-70a2e7a7c948</serial>
Nov 02 04:50:21 user nova-compute[75216]:     </disk>
Nov 02 04:50:21 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:50:21 user nova-compute[75216]:       <mac address="fa:16:3e:07:24:5c"/>
Nov 02 04:50:21 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:21 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:50:21 user nova-compute[75216]:       <target dev="tap737e2805-ed"/>
Nov 02 04:50:21 user nova-compute[75216]:     </interface>
Nov 02 04:50:21 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:50:21 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce/console.log" append="off"/>
Nov 02 04:50:21 user nova-compute[75216]:     </serial>
Nov 02 04:50:21 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:50:21 user nova-compute[75216]:     <video>
Nov 02 04:50:21 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:21 user nova-compute[75216]:     </video>
Nov 02 04:50:21 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:50:21 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:50:21 user nova-compute[75216]:     </rng>
Nov 02 04:50:21 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:50:21 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:50:21 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:50:21 user nova-compute[75216]:     </memballoon>
Nov 02 04:50:21 user nova-compute[75216]:   </devices>
Nov 02 04:50:21 user nova-compute[75216]: </domain>
Nov 02 04:50:21 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548750406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-887008941',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikMoc+LjF47vbDkidZH2OP2JcfDYxU35Wr0fLVuf3xpHoPTwdOEtjII8qkbROyEovHT7tXE5H8ktlhKMgBrP7agimsJbCrj99IVLN7QhRVtQTlyVbrmLDd5mPkiSRl/Q==',key_name='tempest-keypair-1994893486',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3feded7f0e024aa2b09aa6a76f73f0c3',ramdisk_id='',reservation_id='r-lkidyuac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1935368242',owner_user_name='tempest-ServerActionsV293TestJSON-1935368242-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d62e71597ef4d2fac3eb798fac76357',uuid=e7d2e9eb-f209-4d40-ba91-5145ae5256ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converting VIF {"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG os_vif [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf63b651-1adc-534a-94b7-d2cd3cca3864', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap737e2805-ed, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap737e2805-ed, col_values=(('qos', UUID('d894d242-b469-453c-a0a6-b71333756d84')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap737e2805-ed, col_values=(('external_ids', {'iface-id': '737e2805-edf4-49cd-997e-f93852c268d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:24:5c', 'vm-uuid': 'e7d2e9eb-f209-4d40-ba91-5145ae5256ce'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:21 user nova-compute[75216]: INFO os_vif [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed')
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] No VIF found with MAC fa:16:3e:07:24:5c, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:50:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-43d918be-6878-4cdf-9387-4a7562d095e2 req-cf1168bc-4b4e-4f3f-8ad5-c492c5ad11d7 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43d918be-6878-4cdf-9387-4a7562d095e2 req-cf1168bc-4b4e-4f3f-8ad5-c492c5ad11d7 service nova] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43d918be-6878-4cdf-9387-4a7562d095e2 req-cf1168bc-4b4e-4f3f-8ad5-c492c5ad11d7 service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43d918be-6878-4cdf-9387-4a7562d095e2 req-cf1168bc-4b4e-4f3f-8ad5-c492c5ad11d7 service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-43d918be-6878-4cdf-9387-4a7562d095e2 req-cf1168bc-4b4e-4f3f-8ad5-c492c5ad11d7 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] No waiting events found dispatching network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:22 user nova-compute[75216]: WARNING nova.compute.manager [req-43d918be-6878-4cdf-9387-4a7562d095e2 req-cf1168bc-4b4e-4f3f-8ad5-c492c5ad11d7 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received unexpected event network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae for instance with vm_state building and task_state spawning.
Nov 02 04:50:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:50:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Instance spawned successfully.
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-f6f93286-3f88-48df-b4de-13960d859419 req-039f3e42-08a9-49e2-b0b8-4e7e09a46307 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f6f93286-3f88-48df-b4de-13960d859419 req-039f3e42-08a9-49e2-b0b8-4e7e09a46307 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f6f93286-3f88-48df-b4de-13960d859419 req-039f3e42-08a9-49e2-b0b8-4e7e09a46307 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f6f93286-3f88-48df-b4de-13960d859419 req-039f3e42-08a9-49e2-b0b8-4e7e09a46307 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-f6f93286-3f88-48df-b4de-13960d859419 req-039f3e42-08a9-49e2-b0b8-4e7e09a46307 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No waiting events found dispatching network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:23 user nova-compute[75216]: WARNING nova.compute.manager [req-f6f93286-3f88-48df-b4de-13960d859419 req-039f3e42-08a9-49e2-b0b8-4e7e09a46307 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received unexpected event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:23 user nova-compute[75216]: INFO nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 02 04:50:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:50:23 user nova-compute[75216]: INFO nova.compute.manager [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Took 7.87 seconds to build instance.
Nov 02 04:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3deca4af-a5d6-43fd-b9ea-56214609c9ec tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-7c544720-3999-47ac-a682-fe4779c849ca req-df5cbe9c-83e1-4da7-b93f-efaec32972e7 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c544720-3999-47ac-a682-fe4779c849ca req-df5cbe9c-83e1-4da7-b93f-efaec32972e7 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c544720-3999-47ac-a682-fe4779c849ca req-df5cbe9c-83e1-4da7-b93f-efaec32972e7 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c544720-3999-47ac-a682-fe4779c849ca req-df5cbe9c-83e1-4da7-b93f-efaec32972e7 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-7c544720-3999-47ac-a682-fe4779c849ca req-df5cbe9c-83e1-4da7-b93f-efaec32972e7 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No waiting events found dispatching network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:25 user nova-compute[75216]: WARNING nova.compute.manager [req-7c544720-3999-47ac-a682-fe4779c849ca req-df5cbe9c-83e1-4da7-b93f-efaec32972e7 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received unexpected event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 04:50:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:50:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance spawned successfully.
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:50:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75216) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 04:50:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cb5a9a7-3e1e-407e-9eb9-b137901e8964 tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.090s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-changed-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Refreshing instance network info cache due to event network-changed-07462512-5214-4591-9a71-ba1994ef82d2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:50:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] Acquiring lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] Acquired lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Refreshing network info cache for port 07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:50:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updated VIF entry in instance network info cache for port 07462512-5214-4591-9a71-ba1994ef82d2. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:50:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updating instance_info_cache with network_info: [{"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1cad31c-1a78-4527-b948-8a62e3c0a86a req-ffd714e8-32ec-47cb-8fce-68c7c7ce0a1d service nova] Releasing lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lazy-loading 'flavor' on Instance uuid a61cce9f-24a3-4538-be2d-30b562825a16 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:38 user nova-compute[75216]: INFO nova.compute.manager [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Attaching volume 9e76d980-4269-4d41-975a-6eb542af7b1c to /dev/vdb
Nov 02 04:50:38 user nova-compute[75216]: DEBUG os_brick.utils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84a8e3-8e18-48c3-a306-2f3fa8e2bc84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4be585-30a4-4fcb-a54a-febe067b70f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f25a3bb-adf0-48e6-b999-d76d5d83aed7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563f5eb-b729-4b4b-8d28-795fe876848d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:50:38 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b739af3e-a213-4b4a-9a60-f477258d3e55]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG os_brick.utils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:50:38 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updating existing volume attachment record: 2dbee89c-a42d-40b5-bb1a-671c5f2f22b5 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:50:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:50:43 user nova-compute[75216]: INFO nova.compute.claims [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Claim successful on node user
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:50:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.policy [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e3af262ef734b2d8a1b3208e5749fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c9027651a4044a6514c1ab0ec9ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:50:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Creating image(s)
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "/opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "/opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "/opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk 1073741824" returned: 0 in 0.067s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Successfully created port: 0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.211s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Cannot resize image /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Ensure instance console log exists: /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Successfully updated port: 0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-changed-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Refreshing instance network info cache due to event network-changed-0fa57ac7-5baf-476a-b5be-44a9e834d05f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Instance network_info: |[{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Refreshing network info cache for port 0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Start _get_guest_xml network_info=[{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:50:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-505671485',display_name='tempest-ServerActionsTestOtherA-server-505671485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-505671485',id=17,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-oojswmeo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e99b36cc-571e-46d6-9a30-7aa3a0801ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=0fa57ac7-5baf-476a-b5be-44a9e834d05f,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa57ac7-5b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'pci_devices' on Instance uuid e99b36cc-571e-46d6-9a30-7aa3a0801ffd {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:50:46 user nova-compute[75216]:   <uuid>e99b36cc-571e-46d6-9a30-7aa3a0801ffd</uuid>
Nov 02 04:50:46 user nova-compute[75216]:   <name>instance-00000011</name>
Nov 02 04:50:46 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:50:46 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:50:46 user nova-compute[75216]:   <metadata>
Nov 02 04:50:46 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:50:46 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:50:46 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-505671485</nova:name>
Nov 02 04:50:46 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:50:46</nova:creationTime>
Nov 02 04:50:46 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:50:46 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:50:46 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:50:46 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:50:46 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:50:46 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:50:46 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:50:46 user nova-compute[75216]:       <nova:owner>
Nov 02 04:50:46 user nova-compute[75216]:         <nova:user uuid="7e3af262ef734b2d8a1b3208e5749fb3">tempest-ServerActionsTestOtherA-511412938-project-member</nova:user>
Nov 02 04:50:46 user nova-compute[75216]:         <nova:project uuid="597c9027651a4044a6514c1ab0ec9ad8">tempest-ServerActionsTestOtherA-511412938</nova:project>
Nov 02 04:50:46 user nova-compute[75216]:       </nova:owner>
Nov 02 04:50:46 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:50:46 user nova-compute[75216]:       <nova:ports>
Nov 02 04:50:46 user nova-compute[75216]:         <nova:port uuid="0fa57ac7-5baf-476a-b5be-44a9e834d05f">
Nov 02 04:50:46 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 04:50:46 user nova-compute[75216]:         </nova:port>
Nov 02 04:50:46 user nova-compute[75216]:       </nova:ports>
Nov 02 04:50:46 user nova-compute[75216]:     </nova:instance>
Nov 02 04:50:46 user nova-compute[75216]:   </metadata>
Nov 02 04:50:46 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:50:46 user nova-compute[75216]:     <system>
Nov 02 04:50:46 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:50:46 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:50:46 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:50:46 user nova-compute[75216]:       <entry name="serial">e99b36cc-571e-46d6-9a30-7aa3a0801ffd</entry>
Nov 02 04:50:46 user nova-compute[75216]:       <entry name="uuid">e99b36cc-571e-46d6-9a30-7aa3a0801ffd</entry>
Nov 02 04:50:46 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:50:46 user nova-compute[75216]:     </system>
Nov 02 04:50:46 user nova-compute[75216]:   </sysinfo>
Nov 02 04:50:46 user nova-compute[75216]:   <os>
Nov 02 04:50:46 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:50:46 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:50:46 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:50:46 user nova-compute[75216]:   </os>
Nov 02 04:50:46 user nova-compute[75216]:   <features>
Nov 02 04:50:46 user nova-compute[75216]:     <acpi/>
Nov 02 04:50:46 user nova-compute[75216]:     <apic/>
Nov 02 04:50:46 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:50:46 user nova-compute[75216]:   </features>
Nov 02 04:50:46 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:50:46 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:50:46 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:50:46 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:50:46 user nova-compute[75216]:   </clock>
Nov 02 04:50:46 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:50:46 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:50:46 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:50:46 user nova-compute[75216]:   </cpu>
Nov 02 04:50:46 user nova-compute[75216]:   <devices>
Nov 02 04:50:46 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:50:46 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:50:46 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk"/>
Nov 02 04:50:46 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:50:46 user nova-compute[75216]:     </disk>
Nov 02 04:50:46 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:50:46 user nova-compute[75216]:       <mac address="fa:16:3e:f2:0b:df"/>
Nov 02 04:50:46 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:46 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:50:46 user nova-compute[75216]:       <target dev="tap0fa57ac7-5b"/>
Nov 02 04:50:46 user nova-compute[75216]:     </interface>
Nov 02 04:50:46 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:50:46 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/console.log" append="off"/>
Nov 02 04:50:46 user nova-compute[75216]:     </serial>
Nov 02 04:50:46 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:50:46 user nova-compute[75216]:     <video>
Nov 02 04:50:46 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:50:46 user nova-compute[75216]:     </video>
Nov 02 04:50:46 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:50:46 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:50:46 user nova-compute[75216]:     </rng>
Nov 02 04:50:46 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:50:46 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:50:46 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:50:46 user nova-compute[75216]:     </memballoon>
Nov 02 04:50:46 user nova-compute[75216]:   </devices>
Nov 02 04:50:46 user nova-compute[75216]: </domain>
Nov 02 04:50:46 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-505671485',display_name='tempest-ServerActionsTestOtherA-server-505671485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-505671485',id=17,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-oojswmeo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e99b36cc-571e-46d6-9a30-7aa3a0801ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=0fa57ac7-5baf-476a-b5be-44a9e834d05f,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa57ac7-5b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG os_vif [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=0fa57ac7-5baf-476a-b5be-44a9e834d05f,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa57ac7-5b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '102098e8-68ff-557d-8f49-70b6e843f32e', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fa57ac7-5b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fa57ac7-5b, col_values=(('qos', UUID('d5cc7fa8-d5a0-4b2e-aee0-fbdb2369d05d')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fa57ac7-5b, col_values=(('external_ids', {'iface-id': '0fa57ac7-5baf-476a-b5be-44a9e834d05f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:0b:df', 'vm-uuid': 'e99b36cc-571e-46d6-9a30-7aa3a0801ffd'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:46 user nova-compute[75216]: INFO os_vif [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=0fa57ac7-5baf-476a-b5be-44a9e834d05f,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa57ac7-5b')
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:50:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No VIF found with MAC fa:16:3e:f2:0b:df, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:50:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updated VIF entry in instance network info cache for port 0fa57ac7-5baf-476a-b5be-44a9e834d05f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:50:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-82626b64-8264-40bb-8912-5e5e67d2ce08 req-8812beab-6d8d-4700-8d57-518d352840e1 service nova] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-219eb4ec-2267-4441-8a2a-c4a5309a2864 req-f29d6d23-6e59-491b-94f9-91c532706ff8 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-219eb4ec-2267-4441-8a2a-c4a5309a2864 req-f29d6d23-6e59-491b-94f9-91c532706ff8 service nova] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-219eb4ec-2267-4441-8a2a-c4a5309a2864 req-f29d6d23-6e59-491b-94f9-91c532706ff8 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-219eb4ec-2267-4441-8a2a-c4a5309a2864 req-f29d6d23-6e59-491b-94f9-91c532706ff8 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-219eb4ec-2267-4441-8a2a-c4a5309a2864 req-f29d6d23-6e59-491b-94f9-91c532706ff8 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] No waiting events found dispatching network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:48 user nova-compute[75216]: WARNING nova.compute.manager [req-219eb4ec-2267-4441-8a2a-c4a5309a2864 req-f29d6d23-6e59-491b-94f9-91c532706ff8 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received unexpected event network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f for instance with vm_state building and task_state spawning.
Nov 02 04:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-25ec5980-031e-4609-828b-8bdf245cff2e req-81aa86e2-515c-4f51-a194-cd0ec79ad3e9 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25ec5980-031e-4609-828b-8bdf245cff2e req-81aa86e2-515c-4f51-a194-cd0ec79ad3e9 service nova] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25ec5980-031e-4609-828b-8bdf245cff2e req-81aa86e2-515c-4f51-a194-cd0ec79ad3e9 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25ec5980-031e-4609-828b-8bdf245cff2e req-81aa86e2-515c-4f51-a194-cd0ec79ad3e9 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-25ec5980-031e-4609-828b-8bdf245cff2e req-81aa86e2-515c-4f51-a194-cd0ec79ad3e9 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] No waiting events found dispatching network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:50:50 user nova-compute[75216]: WARNING nova.compute.manager [req-25ec5980-031e-4609-828b-8bdf245cff2e req-81aa86e2-515c-4f51-a194-cd0ec79ad3e9 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received unexpected event network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f for instance with vm_state building and task_state spawning.
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:50:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Instance spawned successfully.
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:50:50 user nova-compute[75216]: INFO nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 02 04:50:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:50:50 user nova-compute[75216]: INFO nova.compute.manager [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Took 7.02 seconds to build instance.
Nov 02 04:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c131f961-844e-4110-986b-f6f6421fe52a tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:50:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLZtOHcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:51:01 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:51:01 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:51:01 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:51:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be0ff49-49f5-41a3-b517-7787db2d69aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:51:01 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac39598-710b-483f-b7ab-9335c717d9ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c] added
Nov 02 04:51:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb9bcc-f08e-4a2e-9a52-100235c76877]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[177634f1-d145-4e2d-8410-4ce60de4af73]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLZtOHcI {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLZtOHcI" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d22e7c-74f5-4b3b-96d8-5f3e45591e99]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dLZtOHcI'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717e3ce-b113-455a-b2ab-c1657fbdff69]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38839b-a561-418e-8a32-25e8b1888618]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe82d99-5e55-451b-b13e-d1d26fb47bd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260]
Nov 02 04:51:02 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260] successful.
Nov 02 04:51:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0299e51-7878-416d-896a-9022359998d0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf6076-4e71-494b-bf33-d04cf132b6bd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c (non-flash)
Nov 02 04:51:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:51:02 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c (non-flash)
Nov 02 04:51:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acb903c-188f-4357-ab5d-48f8c1c3ddea]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLZtOHcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23664363766376138', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664363766376138', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG nova.objects.instance [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lazy-loading 'flavor' on Instance uuid a61cce9f-24a3-4538-be2d-30b562825a16 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:51:03 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:51:03 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:51:03 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:51:03 user nova-compute[75216]:   <serial>9e76d980-4269-4d41-975a-6eb542af7b1c</serial>
Nov 02 04:51:03 user nova-compute[75216]: </disk>
Nov 02 04:51:03 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] No VIF found with MAC fa:16:3e:50:58:97, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:51:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-097314d3-d660-4359-810d-a508eb3f676c tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.629s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:05 user nova-compute[75216]: INFO nova.compute.manager [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Detaching volume 9e76d980-4269-4d41-975a-6eb542af7b1c
Nov 02 04:51:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:05 user nova-compute[75216]: INFO nova.virt.block_device [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Attempting to driver detach volume 9e76d980-4269-4d41-975a-6eb542af7b1c from mountpoint /dev/vdb
Nov 02 04:51:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Attempting to detach device vdb from instance a61cce9f-24a3-4538-be2d-30b562825a16 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:51:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:51:05 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:51:05 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:51:05 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:51:05 user nova-compute[75216]:   <serial>9e76d980-4269-4d41-975a-6eb542af7b1c</serial>
Nov 02 04:51:05 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:51:05 user nova-compute[75216]: </disk>
Nov 02 04:51:05 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:51:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Successfully detached device vdb from instance a61cce9f-24a3-4538-be2d-30b562825a16 from the persistent domain config.
Nov 02 04:51:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a61cce9f-24a3-4538-be2d-30b562825a16 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:51:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:51:05 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:51:05 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:51:05 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:51:05 user nova-compute[75216]:   <serial>9e76d980-4269-4d41-975a-6eb542af7b1c</serial>
Nov 02 04:51:05 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:51:05 user nova-compute[75216]: </disk>
Nov 02 04:51:05 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:51:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a61cce9f-24a3-4538-be2d-30b562825a16 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:51:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:51:10 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:10 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7849MB free_disk=25.239192962646484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e7d2e9eb-f209-4d40-ba91-5145ae5256ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a61cce9f-24a3-4538-be2d-30b562825a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:51:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:51:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:51:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a61cce9f-24a3-4538-be2d-30b562825a16 is timed out.
Nov 02 04:51:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Successfully detached device vdb from instance a61cce9f-24a3-4538-be2d-30b562825a16 from the live domain config.
Nov 02 04:51:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLZtOHcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:51:25 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:51:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc835a06-4bae-4c17-9147-4158231d31cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:51:25 user nova-compute[75216]: No targets found.
Nov 02 04:51:25 user nova-compute[75216]: iSNS:
Nov 02 04:51:25 user nova-compute[75216]: No targets found.
Nov 02 04:51:25 user nova-compute[75216]: STATIC:
Nov 02 04:51:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:51:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:51:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:51:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c
Nov 02 04:51:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:51:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:51:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:51:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:51:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:51:25 user nova-compute[75216]: FIRMWARE:
Nov 02 04:51:25 user nova-compute[75216]: No targets found.
Nov 02 04:51:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:51:25 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:51:25 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:51:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6f4e2d-520d-440d-a531-de1aa3c514e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9022452d-272b-4006-b035-4777aa168166]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:51:26 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:51:26 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c (non-flash)
Nov 02 04:51:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:51:26 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:51:26 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c (non-flash)
Nov 02 04:51:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46042148b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8f9d45-f091-4422-910f-6b1468e6ecfe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed2c3c-57ab-4ad8-8ffb-a73e7e782e39]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90037d-1703-4eb4-bfb4-928f9a896054]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7637387c-e1fe-4b25-93e3-104c35669754]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.052s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5315128-367b-40b9-9f2c-91e6cca17746]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29ddfa-6de9-479e-909b-a45bf2fbf422]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260]
Nov 02 04:51:26 user nova-compute[75216]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c, portal: 172.16.0.220,3260] successful.
Nov 02 04:51:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e76d980-4269-4d41-975a-6eb542af7b1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a3d3d-2459-4882-a90d-8b7c94fcc4f3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] <== disconnect_volume: return (356ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:51:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lazy-loading 'flavor' on Instance uuid a61cce9f-24a3-4538-be2d-30b562825a16 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6d467db1-1b5c-4fe9-bae9-4392651ab588 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.925s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:51:28 user nova-compute[75216]: INFO nova.compute.claims [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Claim successful on node user
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:51:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.policy [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '123248b36fe94f2ebf8a2cb77d1b30cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11a39d43d2e4623884c15e26cc0641e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:51:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Creating image(s)
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "/opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "/opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.220s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Successfully created port: 059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk 1073741824" returned: 0 in 0.059s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:51:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Cannot resize image /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Ensure instance console log exists: /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Successfully updated port: 059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquired lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received event network-changed-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Refreshing instance network info cache due to event network-changed-059ad0d2-cc57-4cb0-ab28-2de3a73bc693. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] Acquiring lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Updating instance_info_cache with network_info: [{"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Releasing lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Instance network_info: |[{"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] Acquired lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Refreshing network info cache for port 059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Start _get_guest_xml network_info=[{"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:51:30 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:30 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2115102231',display_name='tempest-ServersNegativeTestJSON-server-2115102231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2115102231',id=18,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11a39d43d2e4623884c15e26cc0641e',ramdisk_id='',reservation_id='r-ie8j324l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1245791276',owner_user_name='tempest-ServersNegativeTestJSON-1245791276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:51:29Z,user_data=None,user_id='123248b36fe94f2ebf8a2cb77d1b30cd',uuid=ec15f413-2cb5-4dec-b2c5-1620b52caf7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converting VIF {"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:e9,bridge_name='br-int',has_traffic_filtering=True,id=059ad0d2-cc57-4cb0-ab28-2de3a73bc693,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ad0d2-cc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lazy-loading 'pci_devices' on Instance uuid ec15f413-2cb5-4dec-b2c5-1620b52caf7c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:51:30 user nova-compute[75216]:   <uuid>ec15f413-2cb5-4dec-b2c5-1620b52caf7c</uuid>
Nov 02 04:51:30 user nova-compute[75216]:   <name>instance-00000012</name>
Nov 02 04:51:30 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:51:30 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:51:30 user nova-compute[75216]:   <metadata>
Nov 02 04:51:30 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:51:30 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:51:30 user nova-compute[75216]:       <nova:name>tempest-ServersNegativeTestJSON-server-2115102231</nova:name>
Nov 02 04:51:30 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:51:30</nova:creationTime>
Nov 02 04:51:30 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:51:30 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:51:30 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:51:30 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:51:30 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:51:30 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:51:30 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:51:30 user nova-compute[75216]:       <nova:owner>
Nov 02 04:51:30 user nova-compute[75216]:         <nova:user uuid="123248b36fe94f2ebf8a2cb77d1b30cd">tempest-ServersNegativeTestJSON-1245791276-project-member</nova:user>
Nov 02 04:51:30 user nova-compute[75216]:         <nova:project uuid="d11a39d43d2e4623884c15e26cc0641e">tempest-ServersNegativeTestJSON-1245791276</nova:project>
Nov 02 04:51:30 user nova-compute[75216]:       </nova:owner>
Nov 02 04:51:30 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:51:30 user nova-compute[75216]:       <nova:ports>
Nov 02 04:51:30 user nova-compute[75216]:         <nova:port uuid="059ad0d2-cc57-4cb0-ab28-2de3a73bc693">
Nov 02 04:51:30 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 04:51:30 user nova-compute[75216]:         </nova:port>
Nov 02 04:51:30 user nova-compute[75216]:       </nova:ports>
Nov 02 04:51:30 user nova-compute[75216]:     </nova:instance>
Nov 02 04:51:30 user nova-compute[75216]:   </metadata>
Nov 02 04:51:30 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:51:30 user nova-compute[75216]:     <system>
Nov 02 04:51:30 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:51:30 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:51:30 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:51:30 user nova-compute[75216]:       <entry name="serial">ec15f413-2cb5-4dec-b2c5-1620b52caf7c</entry>
Nov 02 04:51:30 user nova-compute[75216]:       <entry name="uuid">ec15f413-2cb5-4dec-b2c5-1620b52caf7c</entry>
Nov 02 04:51:30 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:51:30 user nova-compute[75216]:     </system>
Nov 02 04:51:30 user nova-compute[75216]:   </sysinfo>
Nov 02 04:51:30 user nova-compute[75216]:   <os>
Nov 02 04:51:30 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:51:30 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:51:30 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:51:30 user nova-compute[75216]:   </os>
Nov 02 04:51:30 user nova-compute[75216]:   <features>
Nov 02 04:51:30 user nova-compute[75216]:     <acpi/>
Nov 02 04:51:30 user nova-compute[75216]:     <apic/>
Nov 02 04:51:30 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:51:30 user nova-compute[75216]:   </features>
Nov 02 04:51:30 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:51:30 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:51:30 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:51:30 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:51:30 user nova-compute[75216]:   </clock>
Nov 02 04:51:30 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:51:30 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:51:30 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:51:30 user nova-compute[75216]:   </cpu>
Nov 02 04:51:30 user nova-compute[75216]:   <devices>
Nov 02 04:51:30 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:51:30 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:51:30 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk"/>
Nov 02 04:51:30 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:51:30 user nova-compute[75216]:     </disk>
Nov 02 04:51:30 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:51:30 user nova-compute[75216]:       <mac address="fa:16:3e:3f:d7:e9"/>
Nov 02 04:51:30 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:51:30 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:51:30 user nova-compute[75216]:       <target dev="tap059ad0d2-cc"/>
Nov 02 04:51:30 user nova-compute[75216]:     </interface>
Nov 02 04:51:30 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:51:30 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/console.log" append="off"/>
Nov 02 04:51:30 user nova-compute[75216]:     </serial>
Nov 02 04:51:30 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:51:30 user nova-compute[75216]:     <video>
Nov 02 04:51:30 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:51:30 user nova-compute[75216]:     </video>
Nov 02 04:51:30 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:51:30 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:51:30 user nova-compute[75216]:     </rng>
Nov 02 04:51:30 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:51:30 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:51:30 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:51:30 user nova-compute[75216]:     </memballoon>
Nov 02 04:51:30 user nova-compute[75216]:   </devices>
Nov 02 04:51:30 user nova-compute[75216]: </domain>
Nov 02 04:51:30 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2115102231',display_name='tempest-ServersNegativeTestJSON-server-2115102231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2115102231',id=18,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11a39d43d2e4623884c15e26cc0641e',ramdisk_id='',reservation_id='r-ie8j324l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1245791276',owner_user_name='tempest-ServersNegativeTestJSON-1245791276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:51:29Z,user_data=None,user_id='123248b36fe94f2ebf8a2cb77d1b30cd',uuid=ec15f413-2cb5-4dec-b2c5-1620b52caf7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converting VIF {"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:e9,bridge_name='br-int',has_traffic_filtering=True,id=059ad0d2-cc57-4cb0-ab28-2de3a73bc693,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ad0d2-cc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG os_vif [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:e9,bridge_name='br-int',has_traffic_filtering=True,id=059ad0d2-cc57-4cb0-ab28-2de3a73bc693,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ad0d2-cc') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0500a0ad-9cb4-5934-94dc-01fb26981334', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap059ad0d2-cc, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap059ad0d2-cc, col_values=(('qos', UUID('cd2304d8-68dc-4381-b546-de18461238c0')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap059ad0d2-cc, col_values=(('external_ids', {'iface-id': '059ad0d2-cc57-4cb0-ab28-2de3a73bc693', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:d7:e9', 'vm-uuid': 'ec15f413-2cb5-4dec-b2c5-1620b52caf7c'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:51:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:30 user nova-compute[75216]: INFO os_vif [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:e9,bridge_name='br-int',has_traffic_filtering=True,id=059ad0d2-cc57-4cb0-ab28-2de3a73bc693,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ad0d2-cc')
Nov 02 04:51:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:51:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] No VIF found with MAC fa:16:3e:3f:d7:e9, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:51:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Updated VIF entry in instance network info cache for port 059ad0d2-cc57-4cb0-ab28-2de3a73bc693. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:51:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Updating instance_info_cache with network_info: [{"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6753ab9-16f2-4cdf-abc1-28232a47247d req-02cdfa26-6448-4211-9f9e-158dbbef5da3 service nova] Releasing lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-d1d52a4a-6a29-4556-8ad4-183565f9dc0a req-fa3d8197-bddc-46c8-9077-ea95566336d5 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received event network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d1d52a4a-6a29-4556-8ad4-183565f9dc0a req-fa3d8197-bddc-46c8-9077-ea95566336d5 service nova] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d1d52a4a-6a29-4556-8ad4-183565f9dc0a req-fa3d8197-bddc-46c8-9077-ea95566336d5 service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d1d52a4a-6a29-4556-8ad4-183565f9dc0a req-fa3d8197-bddc-46c8-9077-ea95566336d5 service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-d1d52a4a-6a29-4556-8ad4-183565f9dc0a req-fa3d8197-bddc-46c8-9077-ea95566336d5 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] No waiting events found dispatching network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:51:32 user nova-compute[75216]: WARNING nova.compute.manager [req-d1d52a4a-6a29-4556-8ad4-183565f9dc0a req-fa3d8197-bddc-46c8-9077-ea95566336d5 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received unexpected event network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 for instance with vm_state building and task_state spawning.
Nov 02 04:51:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-b4be23e4-a095-4d93-a3d8-0ebf5da887ca req-f8d25f0d-ec24-4375-afda-ff762265b084 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received event network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4be23e4-a095-4d93-a3d8-0ebf5da887ca req-f8d25f0d-ec24-4375-afda-ff762265b084 service nova] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4be23e4-a095-4d93-a3d8-0ebf5da887ca req-f8d25f0d-ec24-4375-afda-ff762265b084 service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4be23e4-a095-4d93-a3d8-0ebf5da887ca req-f8d25f0d-ec24-4375-afda-ff762265b084 service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-b4be23e4-a095-4d93-a3d8-0ebf5da887ca req-f8d25f0d-ec24-4375-afda-ff762265b084 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] No waiting events found dispatching network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:51:34 user nova-compute[75216]: WARNING nova.compute.manager [req-b4be23e4-a095-4d93-a3d8-0ebf5da887ca req-f8d25f0d-ec24-4375-afda-ff762265b084 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received unexpected event network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 for instance with vm_state building and task_state spawning.
Nov 02 04:51:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Instance spawned successfully.
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:34 user nova-compute[75216]: INFO nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 02 04:51:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:51:34 user nova-compute[75216]: INFO nova.compute.manager [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Took 6.26 seconds to build instance.
Nov 02 04:51:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1c6a989e-6945-4b6d-8fae-2dc275b560f3 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.439s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:51:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:51:37 user nova-compute[75216]: INFO nova.compute.claims [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Claim successful on node user
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:51:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.policy [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae71d7b88da2452a9ec4489a0ef49176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6771c51304d446b8338d0d879ede48f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:51:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Creating image(s)
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.220s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk 1073741824" returned: 0 in 0.070s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Successfully created port: 569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Cannot resize image /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Ensure instance console log exists: /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Successfully updated port: 569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received event network-changed-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Refreshing instance network info cache due to event network-changed-569fa55c-2d6d-416a-ae2b-08de61f89d4d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] Acquiring lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Updating instance_info_cache with network_info: [{"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Instance network_info: |[{"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] Acquired lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Refreshing network info cache for port 569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Start _get_guest_xml network_info=[{"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:51:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2036422927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2036422927',id=19,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-akhr64kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:51:39Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=b2016901-3f50-4de3-8eb1-ffa4c67e2b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:06:f2,bridge_name='br-int',has_traffic_filtering=True,id=569fa55c-2d6d-416a-ae2b-08de61f89d4d,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569fa55c-2d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'pci_devices' on Instance uuid b2016901-3f50-4de3-8eb1-ffa4c67e2b78 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:51:40 user nova-compute[75216]:   <uuid>b2016901-3f50-4de3-8eb1-ffa4c67e2b78</uuid>
Nov 02 04:51:40 user nova-compute[75216]:   <name>instance-00000013</name>
Nov 02 04:51:40 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:51:40 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:51:40 user nova-compute[75216]:   <metadata>
Nov 02 04:51:40 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:51:40 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:51:40 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2036422927</nova:name>
Nov 02 04:51:40 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:51:40</nova:creationTime>
Nov 02 04:51:40 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:51:40 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:51:40 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:51:40 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:51:40 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:51:40 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:51:40 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:51:40 user nova-compute[75216]:       <nova:owner>
Nov 02 04:51:40 user nova-compute[75216]:         <nova:user uuid="ae71d7b88da2452a9ec4489a0ef49176">tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member</nova:user>
Nov 02 04:51:40 user nova-compute[75216]:         <nova:project uuid="f6771c51304d446b8338d0d879ede48f">tempest-ServerBootFromVolumeStableRescueTest-1501080447</nova:project>
Nov 02 04:51:40 user nova-compute[75216]:       </nova:owner>
Nov 02 04:51:40 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:51:40 user nova-compute[75216]:       <nova:ports>
Nov 02 04:51:40 user nova-compute[75216]:         <nova:port uuid="569fa55c-2d6d-416a-ae2b-08de61f89d4d">
Nov 02 04:51:40 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 04:51:40 user nova-compute[75216]:         </nova:port>
Nov 02 04:51:40 user nova-compute[75216]:       </nova:ports>
Nov 02 04:51:40 user nova-compute[75216]:     </nova:instance>
Nov 02 04:51:40 user nova-compute[75216]:   </metadata>
Nov 02 04:51:40 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:51:40 user nova-compute[75216]:     <system>
Nov 02 04:51:40 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:51:40 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:51:40 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:51:40 user nova-compute[75216]:       <entry name="serial">b2016901-3f50-4de3-8eb1-ffa4c67e2b78</entry>
Nov 02 04:51:40 user nova-compute[75216]:       <entry name="uuid">b2016901-3f50-4de3-8eb1-ffa4c67e2b78</entry>
Nov 02 04:51:40 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:51:40 user nova-compute[75216]:     </system>
Nov 02 04:51:40 user nova-compute[75216]:   </sysinfo>
Nov 02 04:51:40 user nova-compute[75216]:   <os>
Nov 02 04:51:40 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:51:40 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:51:40 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:51:40 user nova-compute[75216]:   </os>
Nov 02 04:51:40 user nova-compute[75216]:   <features>
Nov 02 04:51:40 user nova-compute[75216]:     <acpi/>
Nov 02 04:51:40 user nova-compute[75216]:     <apic/>
Nov 02 04:51:40 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:51:40 user nova-compute[75216]:   </features>
Nov 02 04:51:40 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:51:40 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:51:40 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:51:40 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:51:40 user nova-compute[75216]:   </clock>
Nov 02 04:51:40 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:51:40 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:51:40 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:51:40 user nova-compute[75216]:   </cpu>
Nov 02 04:51:40 user nova-compute[75216]:   <devices>
Nov 02 04:51:40 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:51:40 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:51:40 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk"/>
Nov 02 04:51:40 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:51:40 user nova-compute[75216]:     </disk>
Nov 02 04:51:40 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:51:40 user nova-compute[75216]:       <mac address="fa:16:3e:5a:06:f2"/>
Nov 02 04:51:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:51:40 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:51:40 user nova-compute[75216]:       <target dev="tap569fa55c-2d"/>
Nov 02 04:51:40 user nova-compute[75216]:     </interface>
Nov 02 04:51:40 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:51:40 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/console.log" append="off"/>
Nov 02 04:51:40 user nova-compute[75216]:     </serial>
Nov 02 04:51:40 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:51:40 user nova-compute[75216]:     <video>
Nov 02 04:51:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:51:40 user nova-compute[75216]:     </video>
Nov 02 04:51:40 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:51:40 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:51:40 user nova-compute[75216]:     </rng>
Nov 02 04:51:40 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:51:40 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:51:40 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:51:40 user nova-compute[75216]:     </memballoon>
Nov 02 04:51:40 user nova-compute[75216]:   </devices>
Nov 02 04:51:40 user nova-compute[75216]: </domain>
Nov 02 04:51:40 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2036422927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2036422927',id=19,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-akhr64kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:51:39Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=b2016901-3f50-4de3-8eb1-ffa4c67e2b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:06:f2,bridge_name='br-int',has_traffic_filtering=True,id=569fa55c-2d6d-416a-ae2b-08de61f89d4d,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569fa55c-2d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG os_vif [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:06:f2,bridge_name='br-int',has_traffic_filtering=True,id=569fa55c-2d6d-416a-ae2b-08de61f89d4d,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569fa55c-2d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5efe6edf-0e0a-53ba-ad66-0c6b0d28b2ae', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap569fa55c-2d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap569fa55c-2d, col_values=(('qos', UUID('9d4458bd-4916-405a-879d-7f5a03e0b78d')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap569fa55c-2d, col_values=(('external_ids', {'iface-id': '569fa55c-2d6d-416a-ae2b-08de61f89d4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:06:f2', 'vm-uuid': 'b2016901-3f50-4de3-8eb1-ffa4c67e2b78'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:40 user nova-compute[75216]: INFO os_vif [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:06:f2,bridge_name='br-int',has_traffic_filtering=True,id=569fa55c-2d6d-416a-ae2b-08de61f89d4d,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569fa55c-2d')
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No VIF found with MAC fa:16:3e:5a:06:f2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Updated VIF entry in instance network info cache for port 569fa55c-2d6d-416a-ae2b-08de61f89d4d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Updating instance_info_cache with network_info: [{"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:51:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79dc295b-18f4-40bb-a6c4-86899c712784 req-68de246b-fb1e-4fb1-a664-698b7c1216c8 service nova] Releasing lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-501213f1-7c76-457b-8527-43a00267e3c9 req-b33e72f6-cd60-413f-9794-a3482d62a800 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received event network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-501213f1-7c76-457b-8527-43a00267e3c9 req-b33e72f6-cd60-413f-9794-a3482d62a800 service nova] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-501213f1-7c76-457b-8527-43a00267e3c9 req-b33e72f6-cd60-413f-9794-a3482d62a800 service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-501213f1-7c76-457b-8527-43a00267e3c9 req-b33e72f6-cd60-413f-9794-a3482d62a800 service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-501213f1-7c76-457b-8527-43a00267e3c9 req-b33e72f6-cd60-413f-9794-a3482d62a800 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] No waiting events found dispatching network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:51:42 user nova-compute[75216]: WARNING nova.compute.manager [req-501213f1-7c76-457b-8527-43a00267e3c9 req-b33e72f6-cd60-413f-9794-a3482d62a800 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received unexpected event network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d for instance with vm_state building and task_state spawning.
Nov 02 04:51:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:51:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Instance spawned successfully.
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-ecc742c6-5e10-4627-828a-555554ba8e78 req-26f07275-0de6-4db2-aa3c-f96e1be3bd8e service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received event network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ecc742c6-5e10-4627-828a-555554ba8e78 req-26f07275-0de6-4db2-aa3c-f96e1be3bd8e service nova] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ecc742c6-5e10-4627-828a-555554ba8e78 req-26f07275-0de6-4db2-aa3c-f96e1be3bd8e service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ecc742c6-5e10-4627-828a-555554ba8e78 req-26f07275-0de6-4db2-aa3c-f96e1be3bd8e service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-ecc742c6-5e10-4627-828a-555554ba8e78 req-26f07275-0de6-4db2-aa3c-f96e1be3bd8e service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] No waiting events found dispatching network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:51:44 user nova-compute[75216]: WARNING nova.compute.manager [req-ecc742c6-5e10-4627-828a-555554ba8e78 req-26f07275-0de6-4db2-aa3c-f96e1be3bd8e service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received unexpected event network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d for instance with vm_state building and task_state spawning.
Nov 02 04:51:44 user nova-compute[75216]: INFO nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 02 04:51:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:51:44 user nova-compute[75216]: INFO nova.compute.manager [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Took 6.76 seconds to build instance.
Nov 02 04:51:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1a690639-fb92-4a5d-a59d-4b724853c297 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.886s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:51:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquired lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:51:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:51:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'info_cache' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:55 user nova-compute[75216]: DEBUG nova.objects.base [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Releasing lock "refresh_cache-5405f6de-5da9-475e-9647-7851ca87371d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:51:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance destroyed successfully.
Nov 02 04:51:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'resources' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG nova.objects.base [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG os_vif [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80407938-aa, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3ce0d51-387e-450c-82e4-549e78ea5e0c) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:56 user nova-compute[75216]: INFO os_vif [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa')
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Start _get_guest_xml network_info=[{"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'numa_topology' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.base [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:51:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.base [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'pci_devices' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.base [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:51:57 user nova-compute[75216]:   <uuid>5405f6de-5da9-475e-9647-7851ca87371d</uuid>
Nov 02 04:51:57 user nova-compute[75216]:   <name>instance-00000003</name>
Nov 02 04:51:57 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:51:57 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:51:57 user nova-compute[75216]:   <metadata>
Nov 02 04:51:57 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:51:57 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:51:57 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-814331073</nova:name>
Nov 02 04:51:57 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:51:57</nova:creationTime>
Nov 02 04:51:57 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:51:57 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:51:57 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:51:57 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:51:57 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:51:57 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:51:57 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:51:57 user nova-compute[75216]:       <nova:owner>
Nov 02 04:51:57 user nova-compute[75216]:         <nova:user uuid="cf5f940bafbf4fb7aa7ace530f7d10c1">tempest-AttachVolumeTestJSON-1577581979-project-member</nova:user>
Nov 02 04:51:57 user nova-compute[75216]:         <nova:project uuid="8baf55600ee343f2b8a6f94622bf9230">tempest-AttachVolumeTestJSON-1577581979</nova:project>
Nov 02 04:51:57 user nova-compute[75216]:       </nova:owner>
Nov 02 04:51:57 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:51:57 user nova-compute[75216]:       <nova:ports>
Nov 02 04:51:57 user nova-compute[75216]:         <nova:port uuid="80407938-aa15-40c0-b5a0-2100f2d9b864">
Nov 02 04:51:57 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 04:51:57 user nova-compute[75216]:         </nova:port>
Nov 02 04:51:57 user nova-compute[75216]:       </nova:ports>
Nov 02 04:51:57 user nova-compute[75216]:     </nova:instance>
Nov 02 04:51:57 user nova-compute[75216]:   </metadata>
Nov 02 04:51:57 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:51:57 user nova-compute[75216]:     <system>
Nov 02 04:51:57 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:51:57 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:51:57 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:51:57 user nova-compute[75216]:       <entry name="serial">5405f6de-5da9-475e-9647-7851ca87371d</entry>
Nov 02 04:51:57 user nova-compute[75216]:       <entry name="uuid">5405f6de-5da9-475e-9647-7851ca87371d</entry>
Nov 02 04:51:57 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:51:57 user nova-compute[75216]:     </system>
Nov 02 04:51:57 user nova-compute[75216]:   </sysinfo>
Nov 02 04:51:57 user nova-compute[75216]:   <os>
Nov 02 04:51:57 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:51:57 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:51:57 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:51:57 user nova-compute[75216]:   </os>
Nov 02 04:51:57 user nova-compute[75216]:   <features>
Nov 02 04:51:57 user nova-compute[75216]:     <acpi/>
Nov 02 04:51:57 user nova-compute[75216]:     <apic/>
Nov 02 04:51:57 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:51:57 user nova-compute[75216]:   </features>
Nov 02 04:51:57 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:51:57 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:51:57 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:51:57 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:51:57 user nova-compute[75216]:   </clock>
Nov 02 04:51:57 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:51:57 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:51:57 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:51:57 user nova-compute[75216]:   </cpu>
Nov 02 04:51:57 user nova-compute[75216]:   <devices>
Nov 02 04:51:57 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:51:57 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:51:57 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk"/>
Nov 02 04:51:57 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:51:57 user nova-compute[75216]:     </disk>
Nov 02 04:51:57 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:51:57 user nova-compute[75216]:       <mac address="fa:16:3e:ba:61:ab"/>
Nov 02 04:51:57 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:51:57 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:51:57 user nova-compute[75216]:       <target dev="tap80407938-aa"/>
Nov 02 04:51:57 user nova-compute[75216]:     </interface>
Nov 02 04:51:57 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:51:57 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/console.log" append="off"/>
Nov 02 04:51:57 user nova-compute[75216]:     </serial>
Nov 02 04:51:57 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:51:57 user nova-compute[75216]:     <video>
Nov 02 04:51:57 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:51:57 user nova-compute[75216]:     </video>
Nov 02 04:51:57 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:51:57 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:51:57 user nova-compute[75216]:     </rng>
Nov 02 04:51:57 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:51:57 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:51:57 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:51:57 user nova-compute[75216]:     </memballoon>
Nov 02 04:51:57 user nova-compute[75216]:   </devices>
Nov 02 04:51:57 user nova-compute[75216]: </domain>
Nov 02 04:51:57 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:51:57 user nova-compute[75216]: INFO nova.compute.claims [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Claim successful on node user
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.objects.base [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.227s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:51:57 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Cannot resize image /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'migration_context' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.objects.base [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Object Instance<5405f6de-5da9-475e-9647-7851ca87371d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG os_vif [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '242fba5d-c742-522b-b846-973745c37886', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80407938-aa, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80407938-aa, col_values=(('qos', UUID('2c0409ed-c1f1-4c77-8422-3affd8b9610a')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80407938-aa, col_values=(('external_ids', {'iface-id': '80407938-aa15-40c0-b5a0-2100f2d9b864', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:61:ab', 'vm-uuid': '5405f6de-5da9-475e-9647-7851ca87371d'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:51:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:58 user nova-compute[75216]: INFO os_vif [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa')
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.policy [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62b4c824a20b4980adda4a3821b28e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78fab3926a14516be58c49540110c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:51:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Creating image(s)
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "/opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "/opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "/opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-changed-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Refreshing instance network info cache due to event network-changed-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] Acquiring lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] Acquired lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Refreshing network info cache for port 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk 1073741824" returned: 0 in 0.065s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Successfully created port: 08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.208s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'flavor' on Instance uuid 5da51a4a-9605-4c02-b3cb-367fafba296f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updated VIF entry in instance network info cache for port 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updating instance_info_cache with network_info: [{"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Cannot resize image /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Ensure instance console log exists: /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-24bcd35f-9b72-43f3-a7b0-4714ff8b5392 req-d6cbd43f-f4fb-40e2-b9aa-a4aa7a189d24 service nova] Releasing lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:51:59 user nova-compute[75216]: INFO nova.compute.manager [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Attaching volume e277a6ca-3728-4356-8b36-b7eecbee3b48 to /dev/vdb
Nov 02 04:51:59 user nova-compute[75216]: DEBUG os_brick.utils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9038036f-2903-43b9-b1b0-97cba3249d5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f0753c-818d-4a14-857a-028fbf6e16b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f3f814-3c78-4ce3-a939-06f461cd93bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5920b3b1-0ec0-4abf-aab6-c9d94ff2d869]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:52:00 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796f596-890c-4809-b985-b6fdc47b0675]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG os_brick.utils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updating existing volume attachment record: e8b3a7d8-65b9-4f42-87ce-e27b0b5ca1d3 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-51b6ba1e-96c8-4440-b375-7659d00d0a81 req-f03caa69-b94c-40cc-b27f-ff2a01dbb0f4 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-51b6ba1e-96c8-4440-b375-7659d00d0a81 req-f03caa69-b94c-40cc-b27f-ff2a01dbb0f4 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-51b6ba1e-96c8-4440-b375-7659d00d0a81 req-f03caa69-b94c-40cc-b27f-ff2a01dbb0f4 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-51b6ba1e-96c8-4440-b375-7659d00d0a81 req-f03caa69-b94c-40cc-b27f-ff2a01dbb0f4 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-51b6ba1e-96c8-4440-b375-7659d00d0a81 req-f03caa69-b94c-40cc-b27f-ff2a01dbb0f4 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:00 user nova-compute[75216]: WARNING nova.compute.manager [req-51b6ba1e-96c8-4440-b375-7659d00d0a81 req-f03caa69-b94c-40cc-b27f-ff2a01dbb0f4 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state stopped and task_state powering-on.
Nov 02 04:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Successfully updated port: 08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "refresh_cache-b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquired lock "refresh_cache-b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Updating instance_info_cache with network_info: [{"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Releasing lock "refresh_cache-b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Instance network_info: |[{"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Start _get_guest_xml network_info=[{"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:52:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:52:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-417234151',display_name='tempest-VolumesAdminNegativeTest-server-417234151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-417234151',id=20,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78fab3926a14516be58c49540110c07',ramdisk_id='',reservation_id='r-0ycdcahv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1191324499',owner_user_name='tempest-VolumesAdminNegativeTest-1191324499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:51:58Z,user_data=None,user_id='62b4c824a20b4980adda4a3821b28e3c',uuid=b42b93b0-0e06-4b9c-87c0-3b5fefdf3970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converting VIF {"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:97:81,bridge_name='br-int',has_traffic_filtering=True,id=08231f55-82b2-4a7b-a097-31ab4e5095e9,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08231f55-82') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.objects.instance [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lazy-loading 'pci_devices' on Instance uuid b42b93b0-0e06-4b9c-87c0-3b5fefdf3970 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:52:01 user nova-compute[75216]:   <uuid>b42b93b0-0e06-4b9c-87c0-3b5fefdf3970</uuid>
Nov 02 04:52:01 user nova-compute[75216]:   <name>instance-00000014</name>
Nov 02 04:52:01 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:52:01 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:52:01 user nova-compute[75216]:   <metadata>
Nov 02 04:52:01 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:52:01 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:52:01 user nova-compute[75216]:       <nova:name>tempest-VolumesAdminNegativeTest-server-417234151</nova:name>
Nov 02 04:52:01 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:52:01</nova:creationTime>
Nov 02 04:52:01 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:52:01 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:52:01 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:52:01 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:52:01 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:52:01 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:52:01 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:52:01 user nova-compute[75216]:       <nova:owner>
Nov 02 04:52:01 user nova-compute[75216]:         <nova:user uuid="62b4c824a20b4980adda4a3821b28e3c">tempest-VolumesAdminNegativeTest-1191324499-project-member</nova:user>
Nov 02 04:52:01 user nova-compute[75216]:         <nova:project uuid="a78fab3926a14516be58c49540110c07">tempest-VolumesAdminNegativeTest-1191324499</nova:project>
Nov 02 04:52:01 user nova-compute[75216]:       </nova:owner>
Nov 02 04:52:01 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:52:01 user nova-compute[75216]:       <nova:ports>
Nov 02 04:52:01 user nova-compute[75216]:         <nova:port uuid="08231f55-82b2-4a7b-a097-31ab4e5095e9">
Nov 02 04:52:01 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 04:52:01 user nova-compute[75216]:         </nova:port>
Nov 02 04:52:01 user nova-compute[75216]:       </nova:ports>
Nov 02 04:52:01 user nova-compute[75216]:     </nova:instance>
Nov 02 04:52:01 user nova-compute[75216]:   </metadata>
Nov 02 04:52:01 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:52:01 user nova-compute[75216]:     <system>
Nov 02 04:52:01 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:52:01 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:52:01 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:52:01 user nova-compute[75216]:       <entry name="serial">b42b93b0-0e06-4b9c-87c0-3b5fefdf3970</entry>
Nov 02 04:52:01 user nova-compute[75216]:       <entry name="uuid">b42b93b0-0e06-4b9c-87c0-3b5fefdf3970</entry>
Nov 02 04:52:01 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:52:01 user nova-compute[75216]:     </system>
Nov 02 04:52:01 user nova-compute[75216]:   </sysinfo>
Nov 02 04:52:01 user nova-compute[75216]:   <os>
Nov 02 04:52:01 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:52:01 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:52:01 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:52:01 user nova-compute[75216]:   </os>
Nov 02 04:52:01 user nova-compute[75216]:   <features>
Nov 02 04:52:01 user nova-compute[75216]:     <acpi/>
Nov 02 04:52:01 user nova-compute[75216]:     <apic/>
Nov 02 04:52:01 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:52:01 user nova-compute[75216]:   </features>
Nov 02 04:52:01 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:52:01 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:52:01 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:52:01 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:52:01 user nova-compute[75216]:   </clock>
Nov 02 04:52:01 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:52:01 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:52:01 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:52:01 user nova-compute[75216]:   </cpu>
Nov 02 04:52:01 user nova-compute[75216]:   <devices>
Nov 02 04:52:01 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:52:01 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:52:01 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk"/>
Nov 02 04:52:01 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:52:01 user nova-compute[75216]:     </disk>
Nov 02 04:52:01 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:52:01 user nova-compute[75216]:       <mac address="fa:16:3e:98:97:81"/>
Nov 02 04:52:01 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:52:01 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:52:01 user nova-compute[75216]:       <target dev="tap08231f55-82"/>
Nov 02 04:52:01 user nova-compute[75216]:     </interface>
Nov 02 04:52:01 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:52:01 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/console.log" append="off"/>
Nov 02 04:52:01 user nova-compute[75216]:     </serial>
Nov 02 04:52:01 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:52:01 user nova-compute[75216]:     <video>
Nov 02 04:52:01 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:52:01 user nova-compute[75216]:     </video>
Nov 02 04:52:01 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:52:01 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:52:01 user nova-compute[75216]:     </rng>
Nov 02 04:52:01 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:52:01 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:52:01 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:52:01 user nova-compute[75216]:     </memballoon>
Nov 02 04:52:01 user nova-compute[75216]:   </devices>
Nov 02 04:52:01 user nova-compute[75216]: </domain>
Nov 02 04:52:01 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-417234151',display_name='tempest-VolumesAdminNegativeTest-server-417234151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-417234151',id=20,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78fab3926a14516be58c49540110c07',ramdisk_id='',reservation_id='r-0ycdcahv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1191324499',owner_user_name='tempest-VolumesAdminNegativeTest-1191324499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:51:58Z,user_data=None,user_id='62b4c824a20b4980adda4a3821b28e3c',uuid=b42b93b0-0e06-4b9c-87c0-3b5fefdf3970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converting VIF {"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:97:81,bridge_name='br-int',has_traffic_filtering=True,id=08231f55-82b2-4a7b-a097-31ab4e5095e9,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08231f55-82') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG os_vif [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:97:81,bridge_name='br-int',has_traffic_filtering=True,id=08231f55-82b2-4a7b-a097-31ab4e5095e9,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08231f55-82') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dbb2569-b4fa-55c0-88fe-31edba5e1cd7', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08231f55-82, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08231f55-82, col_values=(('qos', UUID('584467b6-847c-46c0-8ad4-85a3db3d6d6f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08231f55-82, col_values=(('external_ids', {'iface-id': '08231f55-82b2-4a7b-a097-31ab4e5095e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:97:81', 'vm-uuid': 'b42b93b0-0e06-4b9c-87c0-3b5fefdf3970'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:01 user nova-compute[75216]: INFO os_vif [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:97:81,bridge_name='br-int',has_traffic_filtering=True,id=08231f55-82b2-4a7b-a097-31ab4e5095e9,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08231f55-82')
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:52:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] No VIF found with MAC fa:16:3e:98:97:81, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:02 user nova-compute[75216]: WARNING nova.compute.manager [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state stopped and task_state powering-on.
Nov 02 04:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received event network-changed-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Refreshing instance network info cache due to event network-changed-08231f55-82b2-4a7b-a097-31ab4e5095e9. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] Acquiring lock "refresh_cache-b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] Acquired lock "refresh_cache-b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Refreshing network info cache for port 08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:52:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance rebooted successfully.
Nov 02 04:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-14d97693-0a26-494c-b619-2f2d634fc39c tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:52:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Updated VIF entry in instance network info cache for port 08231f55-82b2-4a7b-a097-31ab4e5095e9. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Updating instance_info_cache with network_info: [{"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6aaa0fe-b737-48c6-9d25-c46a29c2e7eb req-19711d8b-709d-4849-9e19-b1ec7628e97f service nova] Releasing lock "refresh_cache-b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-5354f1a3-d0b7-4995-9491-a280905fc6b5 req-2aec02b1-ecda-429f-acd2-3a1d99b86429 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received event network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5354f1a3-d0b7-4995-9491-a280905fc6b5 req-2aec02b1-ecda-429f-acd2-3a1d99b86429 service nova] Acquiring lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5354f1a3-d0b7-4995-9491-a280905fc6b5 req-2aec02b1-ecda-429f-acd2-3a1d99b86429 service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5354f1a3-d0b7-4995-9491-a280905fc6b5 req-2aec02b1-ecda-429f-acd2-3a1d99b86429 service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-5354f1a3-d0b7-4995-9491-a280905fc6b5 req-2aec02b1-ecda-429f-acd2-3a1d99b86429 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] No waiting events found dispatching network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-5354f1a3-d0b7-4995-9491-a280905fc6b5 req-2aec02b1-ecda-429f-acd2-3a1d99b86429 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received unexpected event network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 for instance with vm_state building and task_state spawning.
Nov 02 04:52:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:03 user nova-compute[75216]: INFO nova.compute.manager [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Terminating instance
Nov 02 04:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-cddd0804-e811-4d8e-8f2f-ee7ff9cc27bd req-281998e5-c6c4-4e1b-a57b-6c2afbc9dc1b service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-unplugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cddd0804-e811-4d8e-8f2f-ee7ff9cc27bd req-281998e5-c6c4-4e1b-a57b-6c2afbc9dc1b service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cddd0804-e811-4d8e-8f2f-ee7ff9cc27bd req-281998e5-c6c4-4e1b-a57b-6c2afbc9dc1b service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cddd0804-e811-4d8e-8f2f-ee7ff9cc27bd req-281998e5-c6c4-4e1b-a57b-6c2afbc9dc1b service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-cddd0804-e811-4d8e-8f2f-ee7ff9cc27bd req-281998e5-c6c4-4e1b-a57b-6c2afbc9dc1b service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No waiting events found dispatching network-vif-unplugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-cddd0804-e811-4d8e-8f2f-ee7ff9cc27bd req-281998e5-c6c4-4e1b-a57b-6c2afbc9dc1b service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-unplugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Instance destroyed successfully.
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lazy-loading 'resources' on Instance uuid e7d2e9eb-f209-4d40-ba91-5145ae5256ce {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548750406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-887008941',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikMoc+LjF47vbDkidZH2OP2JcfDYxU35Wr0fLVuf3xpHoPTwdOEtjII8qkbROyEovHT7tXE5H8ktlhKMgBrP7agimsJbCrj99IVLN7QhRVtQTlyVbrmLDd5mPkiSRl/Q==',key_name='tempest-keypair-1994893486',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:50:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3feded7f0e024aa2b09aa6a76f73f0c3',ramdisk_id='',reservation_id='r-lkidyuac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1935368242',owner_user_name='tempest-ServerActionsV293TestJSON-1935368242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:50:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d62e71597ef4d2fac3eb798fac76357',uuid=e7d2e9eb-f209-4d40-ba91-5145ae5256ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converting VIF {"id": "737e2805-edf4-49cd-997e-f93852c268d1", "address": "fa:16:3e:07:24:5c", "network": {"id": "b31016f1-7e20-4c2b-9844-67ce9ea0a286", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2138117124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3feded7f0e024aa2b09aa6a76f73f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737e2805-ed", "ovs_interfaceid": "737e2805-edf4-49cd-997e-f93852c268d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG os_vif [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap737e2805-ed, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d894d242-b469-453c-a0a6-b71333756d84) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:52:04 user nova-compute[75216]: INFO os_vif [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:24:5c,bridge_name='br-int',has_traffic_filtering=True,id=737e2805-edf4-49cd-997e-f93852c268d1,network=Network(b31016f1-7e20-4c2b-9844-67ce9ea0a286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737e2805-ed')
Nov 02 04:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCSBUbhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:52:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:52:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc69e430-3255-4b09-af65-983cbb829732]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:52:04 user nova-compute[75216]: No targets found.
Nov 02 04:52:04 user nova-compute[75216]: iSNS:
Nov 02 04:52:04 user nova-compute[75216]: No targets found.
Nov 02 04:52:04 user nova-compute[75216]: STATIC:
Nov 02 04:52:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948
Nov 02 04:52:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:52:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:52:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:52:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:52:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:52:04 user nova-compute[75216]: FIRMWARE:
Nov 02 04:52:04 user nova-compute[75216]: No targets found.
Nov 02 04:52:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:52:04 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:52:04 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb5726-7525-49fd-a6a5-f337ba1425de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2d26d0-de57-49cc-884a-7832f853a5b2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:05 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:52:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:05 user nova-compute[75216]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 (non-flash)
Nov 02 04:52:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec43edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d258dd-5da0-4e97-a193-f0c8764c706e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df97969b-9e94-4b96-90e6-4ed0adf9ec7f]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b68e95-788f-40e4-a30f-801cda4e7708]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d58ac-ad6a-430a-b36f-6b49a057db9a]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3503ebaf-ad457eb2baf750b9', '/dev/disk/by-id/scsi-26164343537656232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3503ebaf') {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f34f13-6eb1-4ca6-a141-1caa6cde6867]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6388b5-8ad2-43dd-a22e-1dfd65fab503]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee53c0-b448-41c1-ba97-23ba2916442a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260]
Nov 02 04:52:05 user nova-compute[75216]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948, portal: 172.16.0.220,3260] successful.
Nov 02 04:52:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df56c1c-21c1-475a-90de-70a2e7a7c948 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ee9c79-cae4-4a4e-8388-9311de292370]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] <== disconnect_volume: return (437ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:52:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Deleting instance files /opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce_del
Nov 02 04:52:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Deletion of /opt/stack/data/nova/instances/e7d2e9eb-f209-4d40-ba91-5145ae5256ce_del complete
Nov 02 04:52:05 user nova-compute[75216]: INFO nova.compute.manager [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-63b934a7-2965-425c-9ea2-51f5926a882f req-a705e08e-b40f-46f5-ba7f-ca5ff2378e5b service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received event network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-63b934a7-2965-425c-9ea2-51f5926a882f req-a705e08e-b40f-46f5-ba7f-ca5ff2378e5b service nova] Acquiring lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-63b934a7-2965-425c-9ea2-51f5926a882f req-a705e08e-b40f-46f5-ba7f-ca5ff2378e5b service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-63b934a7-2965-425c-9ea2-51f5926a882f req-a705e08e-b40f-46f5-ba7f-ca5ff2378e5b service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-63b934a7-2965-425c-9ea2-51f5926a882f req-a705e08e-b40f-46f5-ba7f-ca5ff2378e5b service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] No waiting events found dispatching network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:05 user nova-compute[75216]: WARNING nova.compute.manager [req-63b934a7-2965-425c-9ea2-51f5926a882f req-a705e08e-b40f-46f5-ba7f-ca5ff2378e5b service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received unexpected event network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 for instance with vm_state building and task_state spawning.
Nov 02 04:52:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:52:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Instance spawned successfully.
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:06 user nova-compute[75216]: INFO nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-a84e6d4f-4baa-4131-9c61-b65cb0857c97 req-a3dd51ee-c1c7-45e9-8ec4-395316990d49 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a84e6d4f-4baa-4131-9c61-b65cb0857c97 req-a3dd51ee-c1c7-45e9-8ec4-395316990d49 service nova] Acquiring lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a84e6d4f-4baa-4131-9c61-b65cb0857c97 req-a3dd51ee-c1c7-45e9-8ec4-395316990d49 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a84e6d4f-4baa-4131-9c61-b65cb0857c97 req-a3dd51ee-c1c7-45e9-8ec4-395316990d49 service nova] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-a84e6d4f-4baa-4131-9c61-b65cb0857c97 req-a3dd51ee-c1c7-45e9-8ec4-395316990d49 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] No waiting events found dispatching network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:06 user nova-compute[75216]: WARNING nova.compute.manager [req-a84e6d4f-4baa-4131-9c61-b65cb0857c97 req-a3dd51ee-c1c7-45e9-8ec4-395316990d49 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received unexpected event network-vif-plugged-737e2805-edf4-49cd-997e-f93852c268d1 for instance with vm_state active and task_state deleting.
Nov 02 04:52:06 user nova-compute[75216]: INFO nova.compute.manager [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Took 9.18 seconds to build instance.
Nov 02 04:52:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dcd0725b-bfe3-41ca-ac33-a663fe547832 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.405s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:06 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Took 1.39 seconds to deallocate network for instance.
Nov 02 04:52:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-3588231a-4380-427f-9b37-e3aad608712e req-93ee4fe9-4a13-48e6-967f-c97aad07c0d4 service nova] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Received event network-vif-deleted-737e2805-edf4-49cd-997e-f93852c268d1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:07 user nova-compute[75216]: INFO nova.compute.manager [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Took 1.17 seconds to detach 1 volumes for instance.
Nov 02 04:52:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] [instance: e7d2e9eb-f209-4d40-ba91-5145ae5256ce] Deleting volume: 8df56c1c-21c1-475a-90de-70a2e7a7c948 {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-changed-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Refreshing instance network info cache due to event network-changed-40399418-dec4-45aa-9edd-b4239ee6a3ae. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] Acquiring lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] Acquired lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Refreshing network info cache for port 40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:52:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:08 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Deleted allocations for instance e7d2e9eb-f209-4d40-ba91-5145ae5256ce
Nov 02 04:52:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4419488a-e6f2-404b-9f4b-96de9618631f tempest-ServerActionsV293TestJSON-1935368242 tempest-ServerActionsV293TestJSON-1935368242-project-member] Lock "e7d2e9eb-f209-4d40-ba91-5145ae5256ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.958s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Updated VIF entry in instance network info cache for port 40399418-dec4-45aa-9edd-b4239ee6a3ae. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Updating instance_info_cache with network_info: [{"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10fc96fc-1534-4717-b774-f96a2f70af77 req-a2707aae-de3f-4927-ae20-8312ca69a738 service nova] Releasing lock "refresh_cache-fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:52:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating instance_info_cache with network_info: [{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:13 user nova-compute[75216]: INFO nova.compute.manager [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Attaching volume 5b1520aa-b453-4a27-8935-9055a5a9b211 to /dev/vdb
Nov 02 04:52:13 user nova-compute[75216]: DEBUG os_brick.utils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1522c3-1ddc-44d7-99a8-b00a1fc0348b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af047669-8b72-4269-896a-3cbb15e72d74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f789078-e400-4193-b866-ce94ed6bb1ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b11ce37-8898-403d-962d-733bba970dc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:52:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:52:14 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c902e4ca-557e-4f46-8a04-6fc3530978b3]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG os_brick.utils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Updating existing volume attachment record: f9b509b1-5078-4451-a209-cfda4f8215f6 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:52:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:52:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:52:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7608MB free_disk=25.158077239990234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a61cce9f-24a3-4538-be2d-30b562825a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b42b93b0-0e06-4b9c-87c0-3b5fefdf3970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:52:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:52:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:52:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:52:19 user nova-compute[75216]: INFO nova.compute.claims [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Claim successful on node user
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:52:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.policy [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c01f25553f947d781c9c8b8a0953203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b49d78b7cd47db8284e82230b2237f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:52:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Creating image(s)
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "/opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "/opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk 1073741824" returned: 0 in 0.135s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Cannot resize image /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Ensure instance console log exists: /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Successfully created port: 8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Successfully updated port: 8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquired lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-changed-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Refreshing instance network info cache due to event network-changed-8582f3c6-de9c-4add-948d-a266f54b5753. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] Acquiring lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updating instance_info_cache with network_info: [{"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Releasing lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Instance network_info: |[{"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] Acquired lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Refreshing network info cache for port 8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Start _get_guest_xml network_info=[{"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:52:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:52:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-158936682',display_name='tempest-VolumesSnapshotTestJSON-instance-158936682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-158936682',id=21,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD35V0o6euWsrucM32tc9WaI1ZG+w3egZg9N0L7xYHUGU2gm0Y5UI6Jri3cNmK5CojISAvEcc3o9lModv7Mx6pX9L4pgKBknyUwhujZeLi+UQFatCqJichNrSVF01YMXpw==',key_name='tempest-keypair-1603375135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65b49d78b7cd47db8284e82230b2237f',ramdisk_id='',reservation_id='r-8aber8gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1815478259',owner_user_name='tempest-VolumesSnapshotTestJSON-1815478259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:52:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c01f25553f947d781c9c8b8a0953203',uuid=cd78f2c7-3918-4789-9e93-fc802faef0d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converting VIF {"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=8582f3c6-de9c-4add-948d-a266f54b5753,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8582f3c6-de') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'pci_devices' on Instance uuid cd78f2c7-3918-4789-9e93-fc802faef0d7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:52:22 user nova-compute[75216]:   <uuid>cd78f2c7-3918-4789-9e93-fc802faef0d7</uuid>
Nov 02 04:52:22 user nova-compute[75216]:   <name>instance-00000015</name>
Nov 02 04:52:22 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:52:22 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:52:22 user nova-compute[75216]:   <metadata>
Nov 02 04:52:22 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:52:22 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:52:22 user nova-compute[75216]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-158936682</nova:name>
Nov 02 04:52:22 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:52:22</nova:creationTime>
Nov 02 04:52:22 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:52:22 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:52:22 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:52:22 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:52:22 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:52:22 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:52:22 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:52:22 user nova-compute[75216]:       <nova:owner>
Nov 02 04:52:22 user nova-compute[75216]:         <nova:user uuid="7c01f25553f947d781c9c8b8a0953203">tempest-VolumesSnapshotTestJSON-1815478259-project-member</nova:user>
Nov 02 04:52:22 user nova-compute[75216]:         <nova:project uuid="65b49d78b7cd47db8284e82230b2237f">tempest-VolumesSnapshotTestJSON-1815478259</nova:project>
Nov 02 04:52:22 user nova-compute[75216]:       </nova:owner>
Nov 02 04:52:22 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:52:22 user nova-compute[75216]:       <nova:ports>
Nov 02 04:52:22 user nova-compute[75216]:         <nova:port uuid="8582f3c6-de9c-4add-948d-a266f54b5753">
Nov 02 04:52:22 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 04:52:22 user nova-compute[75216]:         </nova:port>
Nov 02 04:52:22 user nova-compute[75216]:       </nova:ports>
Nov 02 04:52:22 user nova-compute[75216]:     </nova:instance>
Nov 02 04:52:22 user nova-compute[75216]:   </metadata>
Nov 02 04:52:22 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:52:22 user nova-compute[75216]:     <system>
Nov 02 04:52:22 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:52:22 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:52:22 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:52:22 user nova-compute[75216]:       <entry name="serial">cd78f2c7-3918-4789-9e93-fc802faef0d7</entry>
Nov 02 04:52:22 user nova-compute[75216]:       <entry name="uuid">cd78f2c7-3918-4789-9e93-fc802faef0d7</entry>
Nov 02 04:52:22 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:52:22 user nova-compute[75216]:     </system>
Nov 02 04:52:22 user nova-compute[75216]:   </sysinfo>
Nov 02 04:52:22 user nova-compute[75216]:   <os>
Nov 02 04:52:22 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:52:22 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:52:22 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:52:22 user nova-compute[75216]:   </os>
Nov 02 04:52:22 user nova-compute[75216]:   <features>
Nov 02 04:52:22 user nova-compute[75216]:     <acpi/>
Nov 02 04:52:22 user nova-compute[75216]:     <apic/>
Nov 02 04:52:22 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:52:22 user nova-compute[75216]:   </features>
Nov 02 04:52:22 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:52:22 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:52:22 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:52:22 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:52:22 user nova-compute[75216]:   </clock>
Nov 02 04:52:22 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:52:22 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:52:22 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:52:22 user nova-compute[75216]:   </cpu>
Nov 02 04:52:22 user nova-compute[75216]:   <devices>
Nov 02 04:52:22 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:52:22 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:52:22 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk"/>
Nov 02 04:52:22 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:52:22 user nova-compute[75216]:     </disk>
Nov 02 04:52:22 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:52:22 user nova-compute[75216]:       <mac address="fa:16:3e:fe:c8:05"/>
Nov 02 04:52:22 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:52:22 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:52:22 user nova-compute[75216]:       <target dev="tap8582f3c6-de"/>
Nov 02 04:52:22 user nova-compute[75216]:     </interface>
Nov 02 04:52:22 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:52:22 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/console.log" append="off"/>
Nov 02 04:52:22 user nova-compute[75216]:     </serial>
Nov 02 04:52:22 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:52:22 user nova-compute[75216]:     <video>
Nov 02 04:52:22 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:52:22 user nova-compute[75216]:     </video>
Nov 02 04:52:22 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:52:22 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:52:22 user nova-compute[75216]:     </rng>
Nov 02 04:52:22 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:52:22 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:52:22 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:52:22 user nova-compute[75216]:     </memballoon>
Nov 02 04:52:22 user nova-compute[75216]:   </devices>
Nov 02 04:52:22 user nova-compute[75216]: </domain>
Nov 02 04:52:22 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-158936682',display_name='tempest-VolumesSnapshotTestJSON-instance-158936682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-158936682',id=21,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD35V0o6euWsrucM32tc9WaI1ZG+w3egZg9N0L7xYHUGU2gm0Y5UI6Jri3cNmK5CojISAvEcc3o9lModv7Mx6pX9L4pgKBknyUwhujZeLi+UQFatCqJichNrSVF01YMXpw==',key_name='tempest-keypair-1603375135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65b49d78b7cd47db8284e82230b2237f',ramdisk_id='',reservation_id='r-8aber8gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1815478259',owner_user_name='tempest-VolumesSnapshotTestJSON-1815478259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:52:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c01f25553f947d781c9c8b8a0953203',uuid=cd78f2c7-3918-4789-9e93-fc802faef0d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converting VIF {"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=8582f3c6-de9c-4add-948d-a266f54b5753,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8582f3c6-de') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG os_vif [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=8582f3c6-de9c-4add-948d-a266f54b5753,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8582f3c6-de') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8320398a-8bd8-5b1c-b69a-d8504b99898d', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8582f3c6-de, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8582f3c6-de, col_values=(('qos', UUID('ef36a8b0-86a0-43f0-b25d-51adf2db03f4')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8582f3c6-de, col_values=(('external_ids', {'iface-id': '8582f3c6-de9c-4add-948d-a266f54b5753', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:c8:05', 'vm-uuid': 'cd78f2c7-3918-4789-9e93-fc802faef0d7'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:22 user nova-compute[75216]: INFO os_vif [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=8582f3c6-de9c-4add-948d-a266f54b5753,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8582f3c6-de')
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:52:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] No VIF found with MAC fa:16:3e:fe:c8:05, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyWegpfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:52:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:52:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:52:23 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c31fba7-7e88-469e-bd9d-eaafa6db8d9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:52:23 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updated VIF entry in instance network info cache for port 8582f3c6-de9c-4add-948d-a266f54b5753. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updating instance_info_cache with network_info: [{"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[71283a31-2339-465e-8cee-954723719099]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48] added
Nov 02 04:52:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a06181c9-53f0-456f-84bb-c8e5b72b1714 req-ca761616-c885-4bdf-9009-8c6cb4aec793 service nova] Releasing lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a592c48-d17d-4109-802e-b6aae36d79fb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[44014c7a-f223-4d27-9855-f055e22c11b0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyWegpfI {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyWegpfI" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5aa795-742a-487c-84c8-eb0f18658fd3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qyWegpfI'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab2bda1-1bc9-4ce8-bc01-99e4413784fb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb01485-f897-4dbb-b03f-bad15e87a8bd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a90158-13b0-4638-8b29-4659c777f7f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260]
Nov 02 04:52:23 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260] successful.
Nov 02 04:52:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a0d50-6f02-4d28-ae99-96700d84f860]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e546cc-0a99-4158-ab83-481c677e3bdf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:23 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:23 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb2419-dc18-4465-a4f4-d418ec0b663f]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:52:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyWegpfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23165633739656236', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165633739656236', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'flavor' on Instance uuid 5da51a4a-9605-4c02-b3cb-367fafba296f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:52:24 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:52:24 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:52:24 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:52:24 user nova-compute[75216]:   <serial>e277a6ca-3728-4356-8b36-b7eecbee3b48</serial>
Nov 02 04:52:24 user nova-compute[75216]: </disk>
Nov 02 04:52:24 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca94f9f8-db2e-4e3c-9f11-5fbb6e9e772e req-f38f0644-0a75-4384-9c34-cd968450bf55 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca94f9f8-db2e-4e3c-9f11-5fbb6e9e772e req-f38f0644-0a75-4384-9c34-cd968450bf55 service nova] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca94f9f8-db2e-4e3c-9f11-5fbb6e9e772e req-f38f0644-0a75-4384-9c34-cd968450bf55 service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca94f9f8-db2e-4e3c-9f11-5fbb6e9e772e req-f38f0644-0a75-4384-9c34-cd968450bf55 service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca94f9f8-db2e-4e3c-9f11-5fbb6e9e772e req-f38f0644-0a75-4384-9c34-cd968450bf55 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] No waiting events found dispatching network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:24 user nova-compute[75216]: WARNING nova.compute.manager [req-ca94f9f8-db2e-4e3c-9f11-5fbb6e9e772e req-f38f0644-0a75-4384-9c34-cd968450bf55 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received unexpected event network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 for instance with vm_state building and task_state spawning.
Nov 02 04:52:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No VIF found with MAC fa:16:3e:14:d4:fc, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f0fc4d6-ba11-4f87-9ccd-e5d54c81db19 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.735s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-66a82401-5e98-4d89-883e-e949f4a8dcc6 req-aeda8da1-639a-41da-86db-26679fbeed1d service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-66a82401-5e98-4d89-883e-e949f4a8dcc6 req-aeda8da1-639a-41da-86db-26679fbeed1d service nova] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-66a82401-5e98-4d89-883e-e949f4a8dcc6 req-aeda8da1-639a-41da-86db-26679fbeed1d service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-66a82401-5e98-4d89-883e-e949f4a8dcc6 req-aeda8da1-639a-41da-86db-26679fbeed1d service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-66a82401-5e98-4d89-883e-e949f4a8dcc6 req-aeda8da1-639a-41da-86db-26679fbeed1d service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] No waiting events found dispatching network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:52:26 user nova-compute[75216]: WARNING nova.compute.manager [req-66a82401-5e98-4d89-883e-e949f4a8dcc6 req-aeda8da1-639a-41da-86db-26679fbeed1d service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received unexpected event network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 for instance with vm_state building and task_state spawning.
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:52:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Instance spawned successfully.
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:52:27 user nova-compute[75216]: INFO nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 02 04:52:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:52:27 user nova-compute[75216]: INFO nova.compute.manager [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Took 7.80 seconds to build instance.
Nov 02 04:52:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbd27ff-9794-4325-a77c-3f9c79d59b8b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.114s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:28 user nova-compute[75216]: INFO nova.compute.manager [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Detaching volume e277a6ca-3728-4356-8b36-b7eecbee3b48
Nov 02 04:52:28 user nova-compute[75216]: INFO nova.virt.block_device [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Attempting to driver detach volume e277a6ca-3728-4356-8b36-b7eecbee3b48 from mountpoint /dev/vdb
Nov 02 04:52:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Attempting to detach device vdb from instance 5da51a4a-9605-4c02-b3cb-367fafba296f from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:52:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:52:28 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:52:28 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:52:28 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:52:28 user nova-compute[75216]:   <serial>e277a6ca-3728-4356-8b36-b7eecbee3b48</serial>
Nov 02 04:52:28 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:52:28 user nova-compute[75216]: </disk>
Nov 02 04:52:28 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:52:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully detached device vdb from instance 5da51a4a-9605-4c02-b3cb-367fafba296f from the persistent domain config.
Nov 02 04:52:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5da51a4a-9605-4c02-b3cb-367fafba296f from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:52:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:52:28 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:52:28 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:52:28 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:52:28 user nova-compute[75216]:   <serial>e277a6ca-3728-4356-8b36-b7eecbee3b48</serial>
Nov 02 04:52:28 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:52:28 user nova-compute[75216]: </disk>
Nov 02 04:52:28 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:52:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5da51a4a-9605-4c02-b3cb-367fafba296f {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:52:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-changed-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Refreshing instance network info cache due to event network-changed-0fa57ac7-5baf-476a-b5be-44a9e834d05f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Refreshing network info cache for port 0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etMVmxkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:52:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:52:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:52:35 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1bf63f-2f3e-4f0c-a054-7c1f29c6d96a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:52:35 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1bb950-6679-45f8-80ec-6239bc5b3061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211] added
Nov 02 04:52:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[76620ed7-4eab-481f-ae08-4b6823ae55f3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ec6a88-f8c9-447c-a137-6a155bbed5f9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etMVmxkO {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etMVmxkO" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ea5b9-1310-4698-9128-849d946cb0b3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etMVmxkO'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad8d5ab-26a2-4e2e-970d-0d31d4979606]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ef0d9b-3ebf-4927-83d6-10a6d850b571]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7745db7-ec1b-4849-bfce-c9c0f3f69b58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260]
Nov 02 04:52:35 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260] successful.
Nov 02 04:52:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54957266-4f50-425a-bee4-98098f06e0e8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1173d209-1c24-4b2b-977c-97dc6c774008]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)
Nov 02 04:52:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8c2b7a-43d2-447c-8896-05dfbf2c1be7]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etMVmxkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updated VIF entry in instance network info cache for port 0fa57ac7-5baf-476a-b5be-44a9e834d05f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4b82d8ce-387c-465f-bfdd-4abd047cd99a req-203de7c6-92e1-4f4a-aae8-71b4f9730910 service nova] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:52:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:52:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23937366565646563', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:52:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937366565646563', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:52:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:52:36 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:52:36 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:52:36 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:52:36 user nova-compute[75216]:   <serial>5b1520aa-b453-4a27-8935-9055a5a9b211</serial>
Nov 02 04:52:36 user nova-compute[75216]: </disk>
Nov 02 04:52:36 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:52:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:52:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:52:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No VIF found with MAC fa:16:3e:23:e1:ba, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:52:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee36b613-d043-4ebe-80dc-81ec4a3d7014 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.480s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:52:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:52:37 user nova-compute[75216]: INFO nova.compute.manager [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Detaching volume 5b1520aa-b453-4a27-8935-9055a5a9b211
Nov 02 04:52:38 user nova-compute[75216]: INFO nova.virt.block_device [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Attempting to driver detach volume 5b1520aa-b453-4a27-8935-9055a5a9b211 from mountpoint /dev/vdb
Nov 02 04:52:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Attempting to detach device vdb from instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:52:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:52:38 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:52:38 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:52:38 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:52:38 user nova-compute[75216]:   <serial>5b1520aa-b453-4a27-8935-9055a5a9b211</serial>
Nov 02 04:52:38 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:52:38 user nova-compute[75216]: </disk>
Nov 02 04:52:38 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:52:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully detached device vdb from instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 from the persistent domain config.
Nov 02 04:52:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:52:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:52:38 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:52:38 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:52:38 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:52:38 user nova-compute[75216]:   <serial>5b1520aa-b453-4a27-8935-9055a5a9b211</serial>
Nov 02 04:52:38 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:52:38 user nova-compute[75216]: </disk>
Nov 02 04:52:38 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:52:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:52:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:48 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5da51a4a-9605-4c02-b3cb-367fafba296f is timed out.
Nov 02 04:52:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully detached device vdb from instance 5da51a4a-9605-4c02-b3cb-367fafba296f from the live domain config.
Nov 02 04:52:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyWegpfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:52:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb616b-7b4c-4c4d-8db7-5b32bc3514c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:52:48 user nova-compute[75216]: No targets found.
Nov 02 04:52:48 user nova-compute[75216]: iSNS:
Nov 02 04:52:48 user nova-compute[75216]: No targets found.
Nov 02 04:52:48 user nova-compute[75216]: STATIC:
Nov 02 04:52:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211
Nov 02 04:52:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:52:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:52:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48
Nov 02 04:52:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:52:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:52:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:52:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:52:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:52:48 user nova-compute[75216]: FIRMWARE:
Nov 02 04:52:48 user nova-compute[75216]: No targets found.
Nov 02 04:52:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:52:48 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:52:48 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[19011986-e626-46bf-aa93-90e59d46d07e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd4811-ad41-489d-8b61-e4a6ea71adec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:48 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:48 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)
Nov 02 04:52:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:48 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 (non-flash)
Nov 02 04:52:48 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)
Nov 02 04:52:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4604154ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb42c96-4f4f-46f6-a7a2-f69cc4c09022]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59740da-7d96-4fc3-91a7-ed057ffb177a]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45acbd2-f2ca-4002-8119-d84203dffd6a]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f994558-5d42-4b2f-ab3d-85154d35a893]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04799884-06c2-4c3e-9b78-23b38f3e1a15]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372fa0d-8636-4813-a681-d75d938e73a3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260]
Nov 02 04:52:49 user nova-compute[75216]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48, portal: 172.16.0.220,3260] successful.
Nov 02 04:52:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e277a6ca-3728-4356-8b36-b7eecbee3b48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7052871e-4ac2-4ceb-8a0b-922ee2008fe4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] <== disconnect_volume: return (289ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:52:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'flavor' on Instance uuid 5da51a4a-9605-4c02-b3cb-367fafba296f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2dd76f3e-2f96-4589-89aa-25fe6fa5661d tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.814s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:52:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:52:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 is timed out.
Nov 02 04:52:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully detached device vdb from instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 from the live domain config.
Nov 02 04:52:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etMVmxkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:52:58 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6429c247-76e1-49b2-b775-1cc35a28a145]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:52:58 user nova-compute[75216]: No targets found.
Nov 02 04:52:58 user nova-compute[75216]: iSNS:
Nov 02 04:52:58 user nova-compute[75216]: No targets found.
Nov 02 04:52:58 user nova-compute[75216]: STATIC:
Nov 02 04:52:58 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211
Nov 02 04:52:58 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:52:58 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:52:58 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:52:58 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:52:58 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:52:58 user nova-compute[75216]: FIRMWARE:
Nov 02 04:52:58 user nova-compute[75216]: No targets found.
Nov 02 04:52:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:52:58 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:52:58 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c020016-bd13-4c00-b2dd-8e9ac1566e56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a55106-1c0d-4f46-9290-91448eb3dcbc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:58 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)
Nov 02 04:52:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:52:58 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 (non-flash)
Nov 02 04:52:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec340ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[781d47ca-4c45-4141-8933-2a95bf003629]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af4dbd1-6015-4124-8add-90a5a793e404]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.079s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3e1915-b5a9-4cee-b296-faf11a6ea441]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a43e90f-38d6-44d2-a41c-78d0e4e35866]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e0111c-736b-42f5-9336-0242853686ad]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb9da08-9ee7-4721-94b1-05cbd8dfefdd]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260]
Nov 02 04:52:58 user nova-compute[75216]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211, portal: 172.16.0.220,3260] successful.
Nov 02 04:52:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1520aa-b453-4a27-8935-9055a5a9b211 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3d059-dc55-4aab-9632-5d75af6246f0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== disconnect_volume: return (392ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:52:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:52:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:52:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2120943e-141d-4897-ba57-41d31d78f6d7 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.928s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:53:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:53:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:53:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:53:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:53:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:53:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:53:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updating instance_info_cache with network_info: [{"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-a61cce9f-24a3-4538-be2d-30b562825a16" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:53:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7389MB free_disk=25.096874237060547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5405f6de-5da9-475e-9647-7851ca87371d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a61cce9f-24a3-4538-be2d-30b562825a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b42b93b0-0e06-4b9c-87c0-3b5fefdf3970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance cd78f2c7-3918-4789-9e93-fc802faef0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:53:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:53:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:53:20 user nova-compute[75216]: INFO nova.compute.claims [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Claim successful on node user
Nov 02 04:53:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:53:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:53:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG nova.policy [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '123248b36fe94f2ebf8a2cb77d1b30cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11a39d43d2e4623884c15e26cc0641e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:53:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Creating image(s)
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "/opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "/opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "/opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk 1073741824" returned: 0 in 0.105s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Successfully created port: 9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Cannot resize image /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Ensure instance console log exists: /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Successfully updated port: 9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "refresh_cache-b785aebc-d26d-4976-ab5a-4d9a3255df6f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquired lock "refresh_cache-b785aebc-d26d-4976-ab5a-4d9a3255df6f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-changed-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Refreshing instance network info cache due to event network-changed-9e939ca8-b499-4e30-993d-5f6e1b10a040. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] Acquiring lock "refresh_cache-b785aebc-d26d-4976-ab5a-4d9a3255df6f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Updating instance_info_cache with network_info: [{"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Releasing lock "refresh_cache-b785aebc-d26d-4976-ab5a-4d9a3255df6f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Instance network_info: |[{"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] Acquired lock "refresh_cache-b785aebc-d26d-4976-ab5a-4d9a3255df6f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Refreshing network info cache for port 9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Start _get_guest_xml network_info=[{"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:53:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1856802463',display_name='tempest-ServersNegativeTestJSON-server-1856802463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1856802463',id=22,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11a39d43d2e4623884c15e26cc0641e',ramdisk_id='',reservation_id='r-rl01j4bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1245791276',owner_user_name='tempest-ServersNegativeTestJSON-1245791276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:53:21Z,user_data=None,user_id='123248b36fe94f2ebf8a2cb77d1b30cd',uuid=b785aebc-d26d-4976-ab5a-4d9a3255df6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converting VIF {"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9e939ca8-b499-4e30-993d-5f6e1b10a040,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e939ca8-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lazy-loading 'pci_devices' on Instance uuid b785aebc-d26d-4976-ab5a-4d9a3255df6f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:53:23 user nova-compute[75216]:   <uuid>b785aebc-d26d-4976-ab5a-4d9a3255df6f</uuid>
Nov 02 04:53:23 user nova-compute[75216]:   <name>instance-00000016</name>
Nov 02 04:53:23 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:53:23 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:53:23 user nova-compute[75216]:   <metadata>
Nov 02 04:53:23 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:53:23 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:53:23 user nova-compute[75216]:       <nova:name>tempest-ServersNegativeTestJSON-server-1856802463</nova:name>
Nov 02 04:53:23 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:53:23</nova:creationTime>
Nov 02 04:53:23 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:53:23 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:53:23 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:53:23 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:53:23 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:53:23 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:53:23 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:53:23 user nova-compute[75216]:       <nova:owner>
Nov 02 04:53:23 user nova-compute[75216]:         <nova:user uuid="123248b36fe94f2ebf8a2cb77d1b30cd">tempest-ServersNegativeTestJSON-1245791276-project-member</nova:user>
Nov 02 04:53:23 user nova-compute[75216]:         <nova:project uuid="d11a39d43d2e4623884c15e26cc0641e">tempest-ServersNegativeTestJSON-1245791276</nova:project>
Nov 02 04:53:23 user nova-compute[75216]:       </nova:owner>
Nov 02 04:53:23 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:53:23 user nova-compute[75216]:       <nova:ports>
Nov 02 04:53:23 user nova-compute[75216]:         <nova:port uuid="9e939ca8-b499-4e30-993d-5f6e1b10a040">
Nov 02 04:53:23 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 04:53:23 user nova-compute[75216]:         </nova:port>
Nov 02 04:53:23 user nova-compute[75216]:       </nova:ports>
Nov 02 04:53:23 user nova-compute[75216]:     </nova:instance>
Nov 02 04:53:23 user nova-compute[75216]:   </metadata>
Nov 02 04:53:23 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:53:23 user nova-compute[75216]:     <system>
Nov 02 04:53:23 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:53:23 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:53:23 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:53:23 user nova-compute[75216]:       <entry name="serial">b785aebc-d26d-4976-ab5a-4d9a3255df6f</entry>
Nov 02 04:53:23 user nova-compute[75216]:       <entry name="uuid">b785aebc-d26d-4976-ab5a-4d9a3255df6f</entry>
Nov 02 04:53:23 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:53:23 user nova-compute[75216]:     </system>
Nov 02 04:53:23 user nova-compute[75216]:   </sysinfo>
Nov 02 04:53:23 user nova-compute[75216]:   <os>
Nov 02 04:53:23 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:53:23 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:53:23 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:53:23 user nova-compute[75216]:   </os>
Nov 02 04:53:23 user nova-compute[75216]:   <features>
Nov 02 04:53:23 user nova-compute[75216]:     <acpi/>
Nov 02 04:53:23 user nova-compute[75216]:     <apic/>
Nov 02 04:53:23 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:53:23 user nova-compute[75216]:   </features>
Nov 02 04:53:23 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:53:23 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:53:23 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:53:23 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:53:23 user nova-compute[75216]:   </clock>
Nov 02 04:53:23 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:53:23 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:53:23 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:53:23 user nova-compute[75216]:   </cpu>
Nov 02 04:53:23 user nova-compute[75216]:   <devices>
Nov 02 04:53:23 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:53:23 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:53:23 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk"/>
Nov 02 04:53:23 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:53:23 user nova-compute[75216]:     </disk>
Nov 02 04:53:23 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:53:23 user nova-compute[75216]:       <mac address="fa:16:3e:f2:f0:e8"/>
Nov 02 04:53:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:53:23 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:53:23 user nova-compute[75216]:       <target dev="tap9e939ca8-b4"/>
Nov 02 04:53:23 user nova-compute[75216]:     </interface>
Nov 02 04:53:23 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:53:23 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/console.log" append="off"/>
Nov 02 04:53:23 user nova-compute[75216]:     </serial>
Nov 02 04:53:23 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:53:23 user nova-compute[75216]:     <video>
Nov 02 04:53:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:53:23 user nova-compute[75216]:     </video>
Nov 02 04:53:23 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:53:23 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:53:23 user nova-compute[75216]:     </rng>
Nov 02 04:53:23 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:53:23 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:53:23 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:53:23 user nova-compute[75216]:     </memballoon>
Nov 02 04:53:23 user nova-compute[75216]:   </devices>
Nov 02 04:53:23 user nova-compute[75216]: </domain>
Nov 02 04:53:23 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1856802463',display_name='tempest-ServersNegativeTestJSON-server-1856802463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1856802463',id=22,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11a39d43d2e4623884c15e26cc0641e',ramdisk_id='',reservation_id='r-rl01j4bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1245791276',owner_user_name='tempest-ServersNegativeTestJSON-1245791276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:53:21Z,user_data=None,user_id='123248b36fe94f2ebf8a2cb77d1b30cd',uuid=b785aebc-d26d-4976-ab5a-4d9a3255df6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converting VIF {"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9e939ca8-b499-4e30-993d-5f6e1b10a040,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e939ca8-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG os_vif [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9e939ca8-b499-4e30-993d-5f6e1b10a040,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e939ca8-b4') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b30161d-b954-572c-9db7-7bf972b1454b', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e939ca8-b4, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e939ca8-b4, col_values=(('qos', UUID('1bc2d284-431c-41af-9571-7738ed1560e3')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e939ca8-b4, col_values=(('external_ids', {'iface-id': '9e939ca8-b499-4e30-993d-5f6e1b10a040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:f0:e8', 'vm-uuid': 'b785aebc-d26d-4976-ab5a-4d9a3255df6f'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:23 user nova-compute[75216]: INFO os_vif [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9e939ca8-b499-4e30-993d-5f6e1b10a040,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e939ca8-b4')
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] No VIF found with MAC fa:16:3e:f2:f0:e8, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Updated VIF entry in instance network info cache for port 9e939ca8-b499-4e30-993d-5f6e1b10a040. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Updating instance_info_cache with network_info: [{"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a68e1395-583b-4563-8ab6-17819a4a6608 req-1aa21a18-3f3d-44c1-8879-53fa7b6bd4c5 service nova] Releasing lock "refresh_cache-b785aebc-d26d-4976-ab5a-4d9a3255df6f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-810a3303-95ab-4d6a-bca0-5c60500c5ac4 req-50f6ddef-0484-4f1e-9e51-2272e68cbd2a service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-810a3303-95ab-4d6a-bca0-5c60500c5ac4 req-50f6ddef-0484-4f1e-9e51-2272e68cbd2a service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-810a3303-95ab-4d6a-bca0-5c60500c5ac4 req-50f6ddef-0484-4f1e-9e51-2272e68cbd2a service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-810a3303-95ab-4d6a-bca0-5c60500c5ac4 req-50f6ddef-0484-4f1e-9e51-2272e68cbd2a service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-810a3303-95ab-4d6a-bca0-5c60500c5ac4 req-50f6ddef-0484-4f1e-9e51-2272e68cbd2a service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:25 user nova-compute[75216]: WARNING nova.compute.manager [req-810a3303-95ab-4d6a-bca0-5c60500c5ac4 req-50f6ddef-0484-4f1e-9e51-2272e68cbd2a service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received unexpected event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with vm_state building and task_state spawning.
Nov 02 04:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:53:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Instance spawned successfully.
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d2ce995-8781-45ec-b4e4-1a90b39e7f37 req-e3b2e5c2-d8aa-466d-a1c3-7a972ec28795 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d2ce995-8781-45ec-b4e4-1a90b39e7f37 req-e3b2e5c2-d8aa-466d-a1c3-7a972ec28795 service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d2ce995-8781-45ec-b4e4-1a90b39e7f37 req-e3b2e5c2-d8aa-466d-a1c3-7a972ec28795 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d2ce995-8781-45ec-b4e4-1a90b39e7f37 req-e3b2e5c2-d8aa-466d-a1c3-7a972ec28795 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d2ce995-8781-45ec-b4e4-1a90b39e7f37 req-e3b2e5c2-d8aa-466d-a1c3-7a972ec28795 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:27 user nova-compute[75216]: WARNING nova.compute.manager [req-3d2ce995-8781-45ec-b4e4-1a90b39e7f37 req-e3b2e5c2-d8aa-466d-a1c3-7a972ec28795 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received unexpected event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with vm_state building and task_state spawning.
Nov 02 04:53:27 user nova-compute[75216]: INFO nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 02 04:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:53:27 user nova-compute[75216]: INFO nova.compute.manager [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Took 7.48 seconds to build instance.
Nov 02 04:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6cd91a5e-82c2-46ba-9de4-8d04df2f3195 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.604s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:28 user nova-compute[75216]: INFO nova.compute.manager [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Terminating instance
Nov 02 04:53:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-dfc96aa6-374e-44fb-89a3-2389c876bc24 req-2e157ab4-50ec-41e7-b57c-377e85806278 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-vif-unplugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc96aa6-374e-44fb-89a3-2389c876bc24 req-2e157ab4-50ec-41e7-b57c-377e85806278 service nova] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc96aa6-374e-44fb-89a3-2389c876bc24 req-2e157ab4-50ec-41e7-b57c-377e85806278 service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc96aa6-374e-44fb-89a3-2389c876bc24 req-2e157ab4-50ec-41e7-b57c-377e85806278 service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-dfc96aa6-374e-44fb-89a3-2389c876bc24 req-2e157ab4-50ec-41e7-b57c-377e85806278 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] No waiting events found dispatching network-vif-unplugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-dfc96aa6-374e-44fb-89a3-2389c876bc24 req-2e157ab4-50ec-41e7-b57c-377e85806278 service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-vif-unplugged-40399418-dec4-45aa-9edd-b4239ee6a3ae for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:53:29 user nova-compute[75216]: INFO nova.compute.manager [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] instance snapshotting
Nov 02 04:53:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Beginning live snapshot process
Nov 02 04:53:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Instance destroyed successfully.
Nov 02 04:53:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'resources' on Instance uuid fb54dbed-eb59-4714-8cbe-da5cc5fe8b21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947082500',display_name='tempest-AttachVolumeNegativeTest-server-947082500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947082500',id=16,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPng9qTHmMn6lBAGTHBFbjv8LYvQpTkreNAXlJgwkAwcKrDv/3I7RJyfinIyPEMited9yt0E4fJxS/WZdyecJ8r9LWL9Ql2TOC1/0jIVGWTGxnWN3VBdBPeyOwJBeG1ObQ==',key_name='tempest-keypair-543058139',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:50:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-ukirvqsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:50:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=fb54dbed-eb59-4714-8cbe-da5cc5fe8b21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "address": "fa:16:3e:23:e1:ba", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40399418-de", "ovs_interfaceid": "40399418-dec4-45aa-9edd-b4239ee6a3ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:e1:ba,bridge_name='br-int',has_traffic_filtering=True,id=40399418-dec4-45aa-9edd-b4239ee6a3ae,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40399418-de') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG os_vif [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:e1:ba,bridge_name='br-int',has_traffic_filtering=True,id=40399418-dec4-45aa-9edd-b4239ee6a3ae,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40399418-de') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40399418-de, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a3c386c-06e2-4d3f-8ba1-7c9445358830) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:29 user nova-compute[75216]: INFO os_vif [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:e1:ba,bridge_name='br-int',has_traffic_filtering=True,id=40399418-dec4-45aa-9edd-b4239ee6a3ae,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40399418-de')
Nov 02 04:53:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Deleting instance files /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21_del
Nov 02 04:53:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Deletion of /opt/stack/data/nova/instances/fb54dbed-eb59-4714-8cbe-da5cc5fe8b21_del complete
Nov 02 04:53:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:29 user nova-compute[75216]: INFO nova.compute.manager [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 02 04:53:29 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm6zgxa3f/e9f3fe33e22f46d0b84cec90df1bd749.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm6zgxa3f/e9f3fe33e22f46d0b84cec90df1bd749.delta 1073741824" returned: 0 in 0.073s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 04:53:30 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:30 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Took 1.18 seconds to deallocate network for instance.
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-4085f881-8ce7-47b9-9920-99267eaf95c5 req-138c091e-d975-4f2b-ab59-742ea5dbc3ec service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4085f881-8ce7-47b9-9920-99267eaf95c5 req-138c091e-d975-4f2b-ab59-742ea5dbc3ec service nova] Acquiring lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4085f881-8ce7-47b9-9920-99267eaf95c5 req-138c091e-d975-4f2b-ab59-742ea5dbc3ec service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4085f881-8ce7-47b9-9920-99267eaf95c5 req-138c091e-d975-4f2b-ab59-742ea5dbc3ec service nova] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-4085f881-8ce7-47b9-9920-99267eaf95c5 req-138c091e-d975-4f2b-ab59-742ea5dbc3ec service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] No waiting events found dispatching network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:30 user nova-compute[75216]: WARNING nova.compute.manager [req-4085f881-8ce7-47b9-9920-99267eaf95c5 req-138c091e-d975-4f2b-ab59-742ea5dbc3ec service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received unexpected event network-vif-plugged-40399418-dec4-45aa-9edd-b4239ee6a3ae for instance with vm_state deleted and task_state None.
Nov 02 04:53:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-4085f881-8ce7-47b9-9920-99267eaf95c5 req-138c091e-d975-4f2b-ab59-742ea5dbc3ec service nova] [instance: fb54dbed-eb59-4714-8cbe-da5cc5fe8b21] Received event network-vif-deleted-40399418-dec4-45aa-9edd-b4239ee6a3ae {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.607s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:31 user nova-compute[75216]: INFO nova.compute.manager [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] instance snapshotting
Nov 02 04:53:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Beginning live snapshot process
Nov 02 04:53:31 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Deleted allocations for instance fb54dbed-eb59-4714-8cbe-da5cc5fe8b21
Nov 02 04:53:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:53:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 04:53:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-54340322-9cf4-4af5-b661-5f47d196185e tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "fb54dbed-eb59-4714-8cbe-da5cc5fe8b21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm6zgxa3f/e9f3fe33e22f46d0b84cec90df1bd749.delta /opt/stack/data/nova/instances/snapshots/tmpm6zgxa3f/e9f3fe33e22f46d0b84cec90df1bd749 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json -f qcow2" returned: 0 in 0.287s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm6zgxa3f/e9f3fe33e22f46d0b84cec90df1bd749.delta /opt/stack/data/nova/instances/snapshots/tmpm6zgxa3f/e9f3fe33e22f46d0b84cec90df1bd749" returned: 0 in 0.720s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Snapshot extracted, beginning image upload
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa3yb25fk/1a54a1d8e49646cf9dc17a9bc44500e5.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa3yb25fk/1a54a1d8e49646cf9dc17a9bc44500e5.delta 1073741824" returned: 0 in 0.064s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 04:53:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:53:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] COPY block job progress, current cursor: 48627712 final cursor: 75563008 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:53:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 04:53:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 04:53:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:34 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:53:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa3yb25fk/1a54a1d8e49646cf9dc17a9bc44500e5.delta /opt/stack/data/nova/instances/snapshots/tmpa3yb25fk/1a54a1d8e49646cf9dc17a9bc44500e5 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:53:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa3yb25fk/1a54a1d8e49646cf9dc17a9bc44500e5.delta /opt/stack/data/nova/instances/snapshots/tmpa3yb25fk/1a54a1d8e49646cf9dc17a9bc44500e5" returned: 0 in 0.702s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Snapshot extracted, beginning image upload
Nov 02 04:53:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:53:35 user nova-compute[75216]: INFO nova.compute.claims [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Claim successful on node user
Nov 02 04:53:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Snapshot image upload complete
Nov 02 04:53:35 user nova-compute[75216]: INFO nova.compute.manager [None req-4a26fa39-c5be-4718-b0ef-55b255af733e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Took 6.80 seconds to snapshot the instance on the hypervisor.
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.926s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:53:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:53:36 user nova-compute[75216]: INFO nova.virt.block_device [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Booting with volume 2d01113d-db63-44c0-95df-346152c151ac at /dev/vda
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.policy [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2cc45316cf74e649bdf7d88cf460c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f36dd21f3ea4792a9b68ed89eb31a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG os_brick.utils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[489475c3-d962-4ac0-b14c-1b2b8160ac43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5571ba-4a65-4768-bc38-01938b903a09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a3a80-bb7a-4aa5-9acb-ae97e7514133]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f412da3b-7a71-4880-9907-4a60fc3dfd3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:53:36 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:53:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[93181be2-5ede-4156-8af1-5795508be567]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG os_brick.utils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:53:36 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating existing volume attachment record: 3b3e66cf-0996-4f89-9a94-3e05b79bea50 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Successfully created port: a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Successfully updated port: a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing instance network info cache due to event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:53:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Snapshot image upload complete
Nov 02 04:53:38 user nova-compute[75216]: INFO nova.compute.manager [None req-11c0686f-eb62-48c4-bbe2-cf0dcd6c1b9a tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Took 6.61 seconds to snapshot the instance on the hypervisor.
Nov 02 04:53:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance network_info: |[{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updated VIF entry in instance network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-457dcdeb-9c05-4be7-a676-3e1f7f624fd8 req-8c12cceb-1732-4141-adab-027a76afa683 service nova] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:53:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:53:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:53:40 user nova-compute[75216]: INFO nova.compute.claims [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Claim successful on node user
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:53:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.policy [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e06c15a638245d2825317e30721ebd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b5ff67267c443b81b9472b5d5560ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:53:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Creating image(s)
Nov 02 04:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "/opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "/opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "/opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b8832b835d6d8f339689e0e2db7579f1b0a9cb1e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b8832b835d6d8f339689e0e2db7579f1b0a9cb1e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Successfully created port: 96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:42 user nova-compute[75216]: DEBUG nova.virt.images [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] 925d1afa-124f-4df5-bb18-a2548b5d4379 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 04:53:42 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.part /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.part /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.converted" returned: 0 in 0.237s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b8832b835d6d8f339689e0e2db7579f1b0a9cb1e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.741s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Successfully updated port: 96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquired lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-changed-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Refreshing instance network info cache due to event network-changed-96c0f432-9445-4f6b-b01a-a6eec6b776ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] Acquiring lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e --force-share --output=json" returned: 0 in 0.220s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b8832b835d6d8f339689e0e2db7579f1b0a9cb1e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b8832b835d6d8f339689e0e2db7579f1b0a9cb1e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e,backing_fmt=raw /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e,backing_fmt=raw /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk 1073741824" returned: 0 in 0.056s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b8832b835d6d8f339689e0e2db7579f1b0a9cb1e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updating instance_info_cache with network_info: [{"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Releasing lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Instance network_info: |[{"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] Acquired lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:53:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Refreshing network info cache for port 96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Ensure instance console log exists: /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Start _get_guest_xml network_info=[{"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='66a7e853e5abe5a052570a4e61a82b2a',container_format='bare',created_at=2023-11-02T04:53:31Z,direct_url=<?>,disk_format='qcow2',id=925d1afa-124f-4df5-bb18-a2548b5d4379,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-818214876',owner='d6b5ff67267c443b81b9472b5d5560ab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T04:53:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '925d1afa-124f-4df5-bb18-a2548b5d4379'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:53:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='66a7e853e5abe5a052570a4e61a82b2a',container_format='bare',created_at=2023-11-02T04:53:31Z,direct_url=<?>,disk_format='qcow2',id=925d1afa-124f-4df5-bb18-a2548b5d4379,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-818214876',owner='d6b5ff67267c443b81b9472b5d5560ab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T04:53:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1842006615',display_name='tempest-TestStampPattern-server-1842006615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1842006615',id=24,image_ref='925d1afa-124f-4df5-bb18-a2548b5d4379',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsRzP3Sg+sJdhvi68MNNzT62rX+Rvtkulq7b2aqFAXRvz/PCDywk8i0/3Qn3hw8DO0i8lgHEo5/PcGZcK4FS6lQGDpD4OwaBWQCg1f0tC4Nct4Wx2de+2XNa4rN9Rx48A==',key_name='tempest-TestStampPattern-2044657716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6b5ff67267c443b81b9472b5d5560ab',ramdisk_id='',reservation_id='r-jyn0g99k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5da51a4a-9605-4c02-b3cb-367fafba296f',image_min_disk='1',image_min_ram='0',image_owner_id='d6b5ff67267c443b81b9472b5d5560ab',image_owner_project_name='tempest-TestStampPattern-774067185',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-774067185-project-member',image_user_id='2e06c15a638245d2825317e30721ebd1',network_allocated='True',owner_project_name='tempest-TestStampPattern-774067185',owner_user_name='tempest-TestStampPattern-774067185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:53:42Z,user_data=None,user_id='2e06c15a638245d2825317e30721ebd1',uuid=b94b3e13-fcc7-45b1-a60f-14f12be9b7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converting VIF {"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=96c0f432-9445-4f6b-b01a-a6eec6b776ec,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c0f432-94') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'pci_devices' on Instance uuid b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:53:44 user nova-compute[75216]:   <uuid>b94b3e13-fcc7-45b1-a60f-14f12be9b7f0</uuid>
Nov 02 04:53:44 user nova-compute[75216]:   <name>instance-00000018</name>
Nov 02 04:53:44 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:53:44 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:53:44 user nova-compute[75216]:   <metadata>
Nov 02 04:53:44 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:53:44 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:53:44 user nova-compute[75216]:       <nova:name>tempest-TestStampPattern-server-1842006615</nova:name>
Nov 02 04:53:44 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:53:44</nova:creationTime>
Nov 02 04:53:44 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:53:44 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:53:44 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:53:44 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:53:44 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:53:44 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:53:44 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:53:44 user nova-compute[75216]:       <nova:owner>
Nov 02 04:53:44 user nova-compute[75216]:         <nova:user uuid="2e06c15a638245d2825317e30721ebd1">tempest-TestStampPattern-774067185-project-member</nova:user>
Nov 02 04:53:44 user nova-compute[75216]:         <nova:project uuid="d6b5ff67267c443b81b9472b5d5560ab">tempest-TestStampPattern-774067185</nova:project>
Nov 02 04:53:44 user nova-compute[75216]:       </nova:owner>
Nov 02 04:53:44 user nova-compute[75216]:       <nova:root type="image" uuid="925d1afa-124f-4df5-bb18-a2548b5d4379"/>
Nov 02 04:53:44 user nova-compute[75216]:       <nova:ports>
Nov 02 04:53:44 user nova-compute[75216]:         <nova:port uuid="96c0f432-9445-4f6b-b01a-a6eec6b776ec">
Nov 02 04:53:44 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 04:53:44 user nova-compute[75216]:         </nova:port>
Nov 02 04:53:44 user nova-compute[75216]:       </nova:ports>
Nov 02 04:53:44 user nova-compute[75216]:     </nova:instance>
Nov 02 04:53:44 user nova-compute[75216]:   </metadata>
Nov 02 04:53:44 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:53:44 user nova-compute[75216]:     <system>
Nov 02 04:53:44 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:53:44 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:53:44 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:53:44 user nova-compute[75216]:       <entry name="serial">b94b3e13-fcc7-45b1-a60f-14f12be9b7f0</entry>
Nov 02 04:53:44 user nova-compute[75216]:       <entry name="uuid">b94b3e13-fcc7-45b1-a60f-14f12be9b7f0</entry>
Nov 02 04:53:44 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:53:44 user nova-compute[75216]:     </system>
Nov 02 04:53:44 user nova-compute[75216]:   </sysinfo>
Nov 02 04:53:44 user nova-compute[75216]:   <os>
Nov 02 04:53:44 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:53:44 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:53:44 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:53:44 user nova-compute[75216]:   </os>
Nov 02 04:53:44 user nova-compute[75216]:   <features>
Nov 02 04:53:44 user nova-compute[75216]:     <acpi/>
Nov 02 04:53:44 user nova-compute[75216]:     <apic/>
Nov 02 04:53:44 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:53:44 user nova-compute[75216]:   </features>
Nov 02 04:53:44 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:53:44 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:53:44 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:53:44 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:53:44 user nova-compute[75216]:   </clock>
Nov 02 04:53:44 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:53:44 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:53:44 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:53:44 user nova-compute[75216]:   </cpu>
Nov 02 04:53:44 user nova-compute[75216]:   <devices>
Nov 02 04:53:44 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:53:44 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:53:44 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk"/>
Nov 02 04:53:44 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:53:44 user nova-compute[75216]:     </disk>
Nov 02 04:53:44 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:53:44 user nova-compute[75216]:       <mac address="fa:16:3e:05:a3:f7"/>
Nov 02 04:53:44 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:53:44 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:53:44 user nova-compute[75216]:       <target dev="tap96c0f432-94"/>
Nov 02 04:53:44 user nova-compute[75216]:     </interface>
Nov 02 04:53:44 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:53:44 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/console.log" append="off"/>
Nov 02 04:53:44 user nova-compute[75216]:     </serial>
Nov 02 04:53:44 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:53:44 user nova-compute[75216]:     <video>
Nov 02 04:53:44 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:53:44 user nova-compute[75216]:     </video>
Nov 02 04:53:44 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:53:44 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:53:44 user nova-compute[75216]:     </rng>
Nov 02 04:53:44 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:53:44 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:53:44 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:53:44 user nova-compute[75216]:     </memballoon>
Nov 02 04:53:44 user nova-compute[75216]:   </devices>
Nov 02 04:53:44 user nova-compute[75216]: </domain>
Nov 02 04:53:44 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1842006615',display_name='tempest-TestStampPattern-server-1842006615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1842006615',id=24,image_ref='925d1afa-124f-4df5-bb18-a2548b5d4379',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsRzP3Sg+sJdhvi68MNNzT62rX+Rvtkulq7b2aqFAXRvz/PCDywk8i0/3Qn3hw8DO0i8lgHEo5/PcGZcK4FS6lQGDpD4OwaBWQCg1f0tC4Nct4Wx2de+2XNa4rN9Rx48A==',key_name='tempest-TestStampPattern-2044657716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6b5ff67267c443b81b9472b5d5560ab',ramdisk_id='',reservation_id='r-jyn0g99k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5da51a4a-9605-4c02-b3cb-367fafba296f',image_min_disk='1',image_min_ram='0',image_owner_id='d6b5ff67267c443b81b9472b5d5560ab',image_owner_project_name='tempest-TestStampPattern-774067185',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-774067185-project-member',image_user_id='2e06c15a638245d2825317e30721ebd1',network_allocated='True',owner_project_name='tempest-TestStampPattern-774067185',owner_user_name='tempest-TestStampPattern-774067185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:53:42Z,user_data=None,user_id='2e06c15a638245d2825317e30721ebd1',uuid=b94b3e13-fcc7-45b1-a60f-14f12be9b7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converting VIF {"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=96c0f432-9445-4f6b-b01a-a6eec6b776ec,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c0f432-94') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG os_vif [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=96c0f432-9445-4f6b-b01a-a6eec6b776ec,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c0f432-94') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1185e0e-4c1d-548b-9b29-f89a0202dc4d', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96c0f432-94, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96c0f432-94, col_values=(('qos', UUID('809bd8e9-1f86-486f-af49-9f55ca99ef9d')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96c0f432-94, col_values=(('external_ids', {'iface-id': '96c0f432-9445-4f6b-b01a-a6eec6b776ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:a3:f7', 'vm-uuid': 'b94b3e13-fcc7-45b1-a60f-14f12be9b7f0'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:44 user nova-compute[75216]: INFO os_vif [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=96c0f432-9445-4f6b-b01a-a6eec6b776ec,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c0f432-94')
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No VIF found with MAC fa:16:3e:05:a3:f7, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updated VIF entry in instance network info cache for port 96c0f432-9445-4f6b-b01a-a6eec6b776ec. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updating instance_info_cache with network_info: [{"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3cf9555a-9ce0-4514-82a1-74839ba49832 req-fd9aa3c3-3dca-4a4d-b3e6-4d85c74a3b61 service nova] Releasing lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-b4e2d779-25ea-41e4-a730-e788c709f8d6 req-c1a54a70-ec5f-4cc1-b4c6-3a2a8a526c04 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4e2d779-25ea-41e4-a730-e788c709f8d6 req-c1a54a70-ec5f-4cc1-b4c6-3a2a8a526c04 service nova] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4e2d779-25ea-41e4-a730-e788c709f8d6 req-c1a54a70-ec5f-4cc1-b4c6-3a2a8a526c04 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4e2d779-25ea-41e4-a730-e788c709f8d6 req-c1a54a70-ec5f-4cc1-b4c6-3a2a8a526c04 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-b4e2d779-25ea-41e4-a730-e788c709f8d6 req-c1a54a70-ec5f-4cc1-b4c6-3a2a8a526c04 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] No waiting events found dispatching network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:45 user nova-compute[75216]: WARNING nova.compute.manager [req-b4e2d779-25ea-41e4-a730-e788c709f8d6 req-c1a54a70-ec5f-4cc1-b4c6-3a2a8a526c04 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received unexpected event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec for instance with vm_state building and task_state spawning.
Nov 02 04:53:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:47 user nova-compute[75216]: INFO nova.compute.manager [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Terminating instance
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:53:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Instance spawned successfully.
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:53:47 user nova-compute[75216]: INFO nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] No waiting events found dispatching network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:47 user nova-compute[75216]: WARNING nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received unexpected event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec for instance with vm_state building and task_state spawning.
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-unplugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Acquiring lock "5405f6de-5da9-475e-9647-7851ca87371d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] Lock "5405f6de-5da9-475e-9647-7851ca87371d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] No waiting events found dispatching network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:53:47 user nova-compute[75216]: WARNING nova.compute.manager [req-db1d4223-9803-4637-a52c-dc7fb417e62e req-0b5dec33-790d-47f6-b4bd-fee376dc8804 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received unexpected event network-vif-plugged-80407938-aa15-40c0-b5a0-2100f2d9b864 for instance with vm_state active and task_state deleting.
Nov 02 04:53:48 user nova-compute[75216]: INFO nova.compute.manager [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Took 7.32 seconds to build instance.
Nov 02 04:53:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Instance destroyed successfully.
Nov 02 04:53:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'resources' on Instance uuid 5405f6de-5da9-475e-9647-7851ca87371d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-814331073',display_name='tempest-AttachVolumeTestJSON-server-814331073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-814331073',id=3,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9e+abUKmolBsQkHoAWel0xxpFiRk//eOPQr5gdgagk0x2WLAphIL7yIhgAxl+DOXIURBHo2eQwsbEvOuNQIGVLN5Kp6FcVzAEdYhO1IJihcR/L9MDL7HAFpL2PilbBPA==',key_name='tempest-keypair-2019287418',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-3nfscejw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=5405f6de-5da9-475e-9647-7851ca87371d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "80407938-aa15-40c0-b5a0-2100f2d9b864", "address": "fa:16:3e:ba:61:ab", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80407938-aa", "ovs_interfaceid": "80407938-aa15-40c0-b5a0-2100f2d9b864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG os_vif [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80407938-aa, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c0409ed-c1f1-4c77-8422-3affd8b9610a) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e9d817c-4c27-471d-956a-80a38e544fc8 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.472s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:48 user nova-compute[75216]: INFO os_vif [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:61:ab,bridge_name='br-int',has_traffic_filtering=True,id=80407938-aa15-40c0-b5a0-2100f2d9b864,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80407938-aa')
Nov 02 04:53:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Deleting instance files /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d_del
Nov 02 04:53:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Deletion of /opt/stack/data/nova/instances/5405f6de-5da9-475e-9647-7851ca87371d_del complete
Nov 02 04:53:48 user nova-compute[75216]: INFO nova.compute.manager [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 02 04:53:48 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:53:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:53:48 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Took 0.80 seconds to deallocate network for instance.
Nov 02 04:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:53:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:49 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Deleted allocations for instance 5405f6de-5da9-475e-9647-7851ca87371d
Nov 02 04:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ea511de-0032-4aa8-a931-dacc2df430c9 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "5405f6de-5da9-475e-9647-7851ca87371d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.545s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b1d06f6-a399-4486-ab7c-e96867fe3b00 req-421ffe42-2e17-469a-9374-b8c9226b1cb0 service nova] [instance: 5405f6de-5da9-475e-9647-7851ca87371d] Received event network-vif-deleted-80407938-aa15-40c0-b5a0-2100f2d9b864 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:53:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:53:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Creating image(s)
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Ensure instance console log exists: /opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Start _get_guest_xml network_info=[{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '3b3e66cf-0996-4f89-9a94-3e05b79bea50', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf29e71d-bdea-49a2-9640-5fb7bc9ff72f', 'attached_at': '', 'detached_at': '', 'volume_id': '2d01113d-db63-44c0-95df-346152c151ac', 'serial': '2d01113d-db63-44c0-95df-346152c151ac'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:53:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:53:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:53:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:53:57 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9429dc-e6d0-45e2-8628-d6a11abb62f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:53:57 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6180a429-43e0-427e-881b-6134dd4c73bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac] added
Nov 02 04:53:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.099s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf1a67e-b717-413c-9f8a-63a8d1334776]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[952733b2-b98c-46dd-af58-1b86a0388177]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPWkMNDu {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPWkMNDu" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2dfb51-7101-4278-b0ea-3550968a776b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oPWkMNDu'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b35bc50-e999-4bf9-ae24-6bc665c3f809]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7883a1cc-d5b6-4f0d-ba88-12e2a2b9b502]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:53:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:53:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e98e8-9b17-4af7-a51f-225f21eb3640]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]
Nov 02 04:53:57 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.
Nov 02 04:53:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab91c22-05c4-44c7-876e-ebfa079c3074]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f00730-7d05-49a5-a3b4-7ba76464be0b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:53:57 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:53:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:53:57 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:53:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e2fe9-2ce1-479c-a0af-c101148b3933]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:53:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23532386435313535', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532386435313535', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1658344299',display_name='tempest-TestShelveInstance-server-1658344299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1658344299',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR2e7O3g+/yfvhFEGDrml2dxdAl7kHa14iolyIEUwDVIRS7NkIFi50QeWJpS40VrFqitAVFd7y/IHiVBAniowp1ZvmQoZ5SWx6/ECJfuV/DKXNxdNFoSJPIaNuhvrkMmg==',key_name='tempest-TestShelveInstance-1286148874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f36dd21f3ea4792a9b68ed89eb31a58',ramdisk_id='',reservation_id='r-zkw0auwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1358632032',owner_user_name='tempest-TestShelveInstance-1358632032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:53:36Z,user_data=None,user_id='e2cc45316cf74e649bdf7d88cf460c6e',uuid=bf29e71d-bdea-49a2-9640-5fb7bc9ff72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converting VIF {"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'pci_devices' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:53:58 user nova-compute[75216]:   <uuid>bf29e71d-bdea-49a2-9640-5fb7bc9ff72f</uuid>
Nov 02 04:53:58 user nova-compute[75216]:   <name>instance-00000017</name>
Nov 02 04:53:58 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:53:58 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:53:58 user nova-compute[75216]:   <metadata>
Nov 02 04:53:58 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:53:58 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:53:58 user nova-compute[75216]:       <nova:name>tempest-TestShelveInstance-server-1658344299</nova:name>
Nov 02 04:53:58 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:53:57</nova:creationTime>
Nov 02 04:53:58 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:53:58 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:53:58 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:53:58 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:53:58 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:53:58 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:53:58 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:53:58 user nova-compute[75216]:       <nova:owner>
Nov 02 04:53:58 user nova-compute[75216]:         <nova:user uuid="e2cc45316cf74e649bdf7d88cf460c6e">tempest-TestShelveInstance-1358632032-project-member</nova:user>
Nov 02 04:53:58 user nova-compute[75216]:         <nova:project uuid="0f36dd21f3ea4792a9b68ed89eb31a58">tempest-TestShelveInstance-1358632032</nova:project>
Nov 02 04:53:58 user nova-compute[75216]:       </nova:owner>
Nov 02 04:53:58 user nova-compute[75216]:       <nova:ports>
Nov 02 04:53:58 user nova-compute[75216]:         <nova:port uuid="a399f62c-e5e9-46bd-afae-7261a28b46b3">
Nov 02 04:53:58 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 04:53:58 user nova-compute[75216]:         </nova:port>
Nov 02 04:53:58 user nova-compute[75216]:       </nova:ports>
Nov 02 04:53:58 user nova-compute[75216]:     </nova:instance>
Nov 02 04:53:58 user nova-compute[75216]:   </metadata>
Nov 02 04:53:58 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:53:58 user nova-compute[75216]:     <system>
Nov 02 04:53:58 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:53:58 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:53:58 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:53:58 user nova-compute[75216]:       <entry name="serial">bf29e71d-bdea-49a2-9640-5fb7bc9ff72f</entry>
Nov 02 04:53:58 user nova-compute[75216]:       <entry name="uuid">bf29e71d-bdea-49a2-9640-5fb7bc9ff72f</entry>
Nov 02 04:53:58 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:53:58 user nova-compute[75216]:     </system>
Nov 02 04:53:58 user nova-compute[75216]:   </sysinfo>
Nov 02 04:53:58 user nova-compute[75216]:   <os>
Nov 02 04:53:58 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:53:58 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:53:58 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:53:58 user nova-compute[75216]:   </os>
Nov 02 04:53:58 user nova-compute[75216]:   <features>
Nov 02 04:53:58 user nova-compute[75216]:     <acpi/>
Nov 02 04:53:58 user nova-compute[75216]:     <apic/>
Nov 02 04:53:58 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:53:58 user nova-compute[75216]:   </features>
Nov 02 04:53:58 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:53:58 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:53:58 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:53:58 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:53:58 user nova-compute[75216]:   </clock>
Nov 02 04:53:58 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:53:58 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:53:58 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:53:58 user nova-compute[75216]:   </cpu>
Nov 02 04:53:58 user nova-compute[75216]:   <devices>
Nov 02 04:53:58 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:53:58 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:53:58 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 04:53:58 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:53:58 user nova-compute[75216]:       <serial>2d01113d-db63-44c0-95df-346152c151ac</serial>
Nov 02 04:53:58 user nova-compute[75216]:     </disk>
Nov 02 04:53:58 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:53:58 user nova-compute[75216]:       <mac address="fa:16:3e:fb:34:c5"/>
Nov 02 04:53:58 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:53:58 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:53:58 user nova-compute[75216]:       <target dev="tapa399f62c-e5"/>
Nov 02 04:53:58 user nova-compute[75216]:     </interface>
Nov 02 04:53:58 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:53:58 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f/console.log" append="off"/>
Nov 02 04:53:58 user nova-compute[75216]:     </serial>
Nov 02 04:53:58 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:53:58 user nova-compute[75216]:     <video>
Nov 02 04:53:58 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:53:58 user nova-compute[75216]:     </video>
Nov 02 04:53:58 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:53:58 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:53:58 user nova-compute[75216]:     </rng>
Nov 02 04:53:58 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:53:58 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:53:58 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:53:58 user nova-compute[75216]:     </memballoon>
Nov 02 04:53:58 user nova-compute[75216]:   </devices>
Nov 02 04:53:58 user nova-compute[75216]: </domain>
Nov 02 04:53:58 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1658344299',display_name='tempest-TestShelveInstance-server-1658344299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1658344299',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR2e7O3g+/yfvhFEGDrml2dxdAl7kHa14iolyIEUwDVIRS7NkIFi50QeWJpS40VrFqitAVFd7y/IHiVBAniowp1ZvmQoZ5SWx6/ECJfuV/DKXNxdNFoSJPIaNuhvrkMmg==',key_name='tempest-TestShelveInstance-1286148874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f36dd21f3ea4792a9b68ed89eb31a58',ramdisk_id='',reservation_id='r-zkw0auwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1358632032',owner_user_name='tempest-TestShelveInstance-1358632032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:53:36Z,user_data=None,user_id='e2cc45316cf74e649bdf7d88cf460c6e',uuid=bf29e71d-bdea-49a2-9640-5fb7bc9ff72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converting VIF {"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG os_vif [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f547ee26-f69d-5dae-9a81-dc5382932a54', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa399f62c-e5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa399f62c-e5, col_values=(('qos', UUID('bed9db97-f736-4d32-a664-8669025179f1')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa399f62c-e5, col_values=(('external_ids', {'iface-id': 'a399f62c-e5e9-46bd-afae-7261a28b46b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:34:c5', 'vm-uuid': 'bf29e71d-bdea-49a2-9640-5fb7bc9ff72f'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:53:58 user nova-compute[75216]: INFO os_vif [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5')
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:53:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] No VIF found with MAC fa:16:3e:fb:34:c5, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-502a03e4-354e-4eee-8a7c-34c61286442e req-31830ae0-bd4a-4805-8ad5-3df7d2b16f3d service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-502a03e4-354e-4eee-8a7c-34c61286442e req-31830ae0-bd4a-4805-8ad5-3df7d2b16f3d service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-502a03e4-354e-4eee-8a7c-34c61286442e req-31830ae0-bd4a-4805-8ad5-3df7d2b16f3d service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-502a03e4-354e-4eee-8a7c-34c61286442e req-31830ae0-bd4a-4805-8ad5-3df7d2b16f3d service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-502a03e4-354e-4eee-8a7c-34c61286442e req-31830ae0-bd4a-4805-8ad5-3df7d2b16f3d service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:00 user nova-compute[75216]: WARNING nova.compute.manager [req-502a03e4-354e-4eee-8a7c-34c61286442e req-31830ae0-bd4a-4805-8ad5-3df7d2b16f3d service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state building and task_state spawning.
Nov 02 04:54:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:54:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance spawned successfully.
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:02 user nova-compute[75216]: INFO nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-68b16d87-6382-4bb2-942b-94487011ba12 req-086dd521-0f2a-46b7-ab67-82fad48ce902 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68b16d87-6382-4bb2-942b-94487011ba12 req-086dd521-0f2a-46b7-ab67-82fad48ce902 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68b16d87-6382-4bb2-942b-94487011ba12 req-086dd521-0f2a-46b7-ab67-82fad48ce902 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68b16d87-6382-4bb2-942b-94487011ba12 req-086dd521-0f2a-46b7-ab67-82fad48ce902 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-68b16d87-6382-4bb2-942b-94487011ba12 req-086dd521-0f2a-46b7-ab67-82fad48ce902 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:02 user nova-compute[75216]: WARNING nova.compute.manager [req-68b16d87-6382-4bb2-942b-94487011ba12 req-086dd521-0f2a-46b7-ab67-82fad48ce902 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state building and task_state spawning.
Nov 02 04:54:02 user nova-compute[75216]: INFO nova.compute.manager [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Took 27.63 seconds to build instance.
Nov 02 04:54:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7dbe3fc6-a74b-4983-9983-693bdd56d9dc tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.761s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:03 user nova-compute[75216]: INFO nova.compute.manager [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Terminating instance
Nov 02 04:54:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:54:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-c49345eb-01f2-446e-b09b-2178cecf6768 req-4962e9ef-3a53-4570-8beb-ba318cf48275 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received event network-vif-unplugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c49345eb-01f2-446e-b09b-2178cecf6768 req-4962e9ef-3a53-4570-8beb-ba318cf48275 service nova] Acquiring lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c49345eb-01f2-446e-b09b-2178cecf6768 req-4962e9ef-3a53-4570-8beb-ba318cf48275 service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c49345eb-01f2-446e-b09b-2178cecf6768 req-4962e9ef-3a53-4570-8beb-ba318cf48275 service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-c49345eb-01f2-446e-b09b-2178cecf6768 req-4962e9ef-3a53-4570-8beb-ba318cf48275 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] No waiting events found dispatching network-vif-unplugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-c49345eb-01f2-446e-b09b-2178cecf6768 req-4962e9ef-3a53-4570-8beb-ba318cf48275 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received event network-vif-unplugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Instance destroyed successfully.
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lazy-loading 'resources' on Instance uuid b42b93b0-0e06-4b9c-87c0-3b5fefdf3970 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-417234151',display_name='tempest-VolumesAdminNegativeTest-server-417234151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-417234151',id=20,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78fab3926a14516be58c49540110c07',ramdisk_id='',reservation_id='r-0ycdcahv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1191324499',owner_user_name='tempest-VolumesAdminNegativeTest-1191324499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:52:06Z,user_data=None,user_id='62b4c824a20b4980adda4a3821b28e3c',uuid=b42b93b0-0e06-4b9c-87c0-3b5fefdf3970,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converting VIF {"id": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "address": "fa:16:3e:98:97:81", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08231f55-82", "ovs_interfaceid": "08231f55-82b2-4a7b-a097-31ab4e5095e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:97:81,bridge_name='br-int',has_traffic_filtering=True,id=08231f55-82b2-4a7b-a097-31ab4e5095e9,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08231f55-82') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG os_vif [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:97:81,bridge_name='br-int',has_traffic_filtering=True,id=08231f55-82b2-4a7b-a097-31ab4e5095e9,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08231f55-82') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08231f55-82, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=584467b6-847c-46c0-8ad4-85a3db3d6d6f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:04 user nova-compute[75216]: INFO os_vif [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:97:81,bridge_name='br-int',has_traffic_filtering=True,id=08231f55-82b2-4a7b-a097-31ab4e5095e9,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08231f55-82')
Nov 02 04:54:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Deleting instance files /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970_del
Nov 02 04:54:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Deletion of /opt/stack/data/nova/instances/b42b93b0-0e06-4b9c-87c0-3b5fefdf3970_del complete
Nov 02 04:54:04 user nova-compute[75216]: INFO nova.compute.manager [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 02 04:54:04 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:05 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Took 0.52 seconds to deallocate network for instance.
Nov 02 04:54:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d353facb-00d0-410c-8e4c-4654765e33b6 req-cbe015a8-06d2-4a68-8545-b088750ae864 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received event network-vif-deleted-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:05 user nova-compute[75216]: INFO nova.compute.manager [req-d353facb-00d0-410c-8e4c-4654765e33b6 req-cbe015a8-06d2-4a68-8545-b088750ae864 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Neutron deleted interface 08231f55-82b2-4a7b-a097-31ab4e5095e9; detaching it from the instance and deleting it from the info cache
Nov 02 04:54:05 user nova-compute[75216]: DEBUG nova.network.neutron [req-d353facb-00d0-410c-8e4c-4654765e33b6 req-cbe015a8-06d2-4a68-8545-b088750ae864 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d353facb-00d0-410c-8e4c-4654765e33b6 req-cbe015a8-06d2-4a68-8545-b088750ae864 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Detach interface failed, port_id=08231f55-82b2-4a7b-a097-31ab4e5095e9, reason: Instance b42b93b0-0e06-4b9c-87c0-3b5fefdf3970 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:54:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:05 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Deleted allocations for instance b42b93b0-0e06-4b9c-87c0-3b5fefdf3970
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3f666213-5309-4ee0-824b-25f0b59bfdeb tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.123s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-b466d663-a6cc-4ee3-beb9-2bda3909b789 req-9fda6b16-634c-4203-85d4-497da68d09f7 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received event network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b466d663-a6cc-4ee3-beb9-2bda3909b789 req-9fda6b16-634c-4203-85d4-497da68d09f7 service nova] Acquiring lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b466d663-a6cc-4ee3-beb9-2bda3909b789 req-9fda6b16-634c-4203-85d4-497da68d09f7 service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b466d663-a6cc-4ee3-beb9-2bda3909b789 req-9fda6b16-634c-4203-85d4-497da68d09f7 service nova] Lock "b42b93b0-0e06-4b9c-87c0-3b5fefdf3970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-b466d663-a6cc-4ee3-beb9-2bda3909b789 req-9fda6b16-634c-4203-85d4-497da68d09f7 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] No waiting events found dispatching network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:06 user nova-compute[75216]: WARNING nova.compute.manager [req-b466d663-a6cc-4ee3-beb9-2bda3909b789 req-9fda6b16-634c-4203-85d4-497da68d09f7 service nova] [instance: b42b93b0-0e06-4b9c-87c0-3b5fefdf3970] Received unexpected event network-vif-plugged-08231f55-82b2-4a7b-a097-31ab4e5095e9 for instance with vm_state deleted and task_state None.
Nov 02 04:54:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-changed-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Refreshing instance network info cache due to event network-changed-8582f3c6-de9c-4add-948d-a266f54b5753. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] Acquiring lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] Acquired lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Refreshing network info cache for port 8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'flavor' on Instance uuid cd78f2c7-3918-4789-9e93-fc802faef0d7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:54:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Ignoring supplied device name: /dev/vdb
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:11 user nova-compute[75216]: INFO nova.compute.manager [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Attaching volume 37c27351-edb8-43cf-8c40-12eac36b1105 to /dev/vdb
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updated VIF entry in instance network info cache for port 8582f3c6-de9c-4add-948d-a266f54b5753. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updating instance_info_cache with network_info: [{"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[782bbe4e-5205-4fdb-ac39-0984b5741502]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdab9d5-395f-4a3a-951f-b5efb56cf72a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f4955a23-c5e9-40c2-bf9d-c1a0da5d8e06 req-2d67d27a-91d3-43f0-aa9f-f278fb64462f service nova] Releasing lock "refresh_cache-cd78f2c7-3918-4789-9e93-fc802faef0d7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7609a4-9ae3-44e7-803f-4c38b7c8cd97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacc09d5-7d72-406e-afb8-6dee54447cc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:54:11 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32673c8-ddff-4673-bf05-b91f192b0a9f]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updating existing volume attachment record: 8a2b12cf-d6ef-468c-8f23-65f8146751ed {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:54:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:54:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7523MB free_disk=24.945865631103516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a61cce9f-24a3-4538-be2d-30b562825a16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance cd78f2c7-3918-4789-9e93-fc802faef0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b785aebc-d26d-4976-ab5a-4d9a3255df6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance bf29e71d-bdea-49a2-9640-5fb7bc9ff72f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 04:54:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:54:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 04:54:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:54:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:54:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:54:22 user nova-compute[75216]: INFO nova.compute.claims [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Claim successful on node user
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:54:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:54:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG nova.policy [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43528060361f4924b8a858bdd2e731cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01690c91146afa3833bea67f8157f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:54:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Creating image(s)
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "/opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "/opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk 1073741824" returned: 0 in 0.092s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Successfully created port: c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Cannot resize image /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Ensure instance console log exists: /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Successfully updated port: c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquired lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-changed-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Refreshing instance network info cache due to event network-changed-c90b667f-9641-4074-b8b8-2cbdcd7abee3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] Acquiring lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:54:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Updating instance_info_cache with network_info: [{"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Releasing lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Instance network_info: |[{"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] Acquired lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Refreshing network info cache for port c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Start _get_guest_xml network_info=[{"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:54:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-597868679',display_name='tempest-AttachVolumeNegativeTest-server-597868679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-597868679',id=25,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRXCiq2yOIRdQxyJndrPOL+c/KxpbQEd3TCSp+GYgutIx9e3QQLa0mCGjYV/bi++5nJPVgD/XuCm5e0wmcuGp3amay7mZFsuINz+8xw6Sw2VKUT0zeTOfLfkokPjXOIw==',key_name='tempest-keypair-664360866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-4gtlmfur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=709622ce-3956-4747-b274-00bb775d5fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:65:76,bridge_name='br-int',has_traffic_filtering=True,id=c90b667f-9641-4074-b8b8-2cbdcd7abee3,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90b667f-96') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'pci_devices' on Instance uuid 709622ce-3956-4747-b274-00bb775d5fcc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:54:25 user nova-compute[75216]:   <uuid>709622ce-3956-4747-b274-00bb775d5fcc</uuid>
Nov 02 04:54:25 user nova-compute[75216]:   <name>instance-00000019</name>
Nov 02 04:54:25 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:54:25 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:54:25 user nova-compute[75216]:   <metadata>
Nov 02 04:54:25 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:54:25 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:54:25 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-597868679</nova:name>
Nov 02 04:54:25 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:54:25</nova:creationTime>
Nov 02 04:54:25 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:54:25 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:54:25 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:54:25 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:54:25 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:54:25 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:54:25 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:54:25 user nova-compute[75216]:       <nova:owner>
Nov 02 04:54:25 user nova-compute[75216]:         <nova:user uuid="43528060361f4924b8a858bdd2e731cc">tempest-AttachVolumeNegativeTest-1766043636-project-member</nova:user>
Nov 02 04:54:25 user nova-compute[75216]:         <nova:project uuid="e1c01690c91146afa3833bea67f8157f">tempest-AttachVolumeNegativeTest-1766043636</nova:project>
Nov 02 04:54:25 user nova-compute[75216]:       </nova:owner>
Nov 02 04:54:25 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:54:25 user nova-compute[75216]:       <nova:ports>
Nov 02 04:54:25 user nova-compute[75216]:         <nova:port uuid="c90b667f-9641-4074-b8b8-2cbdcd7abee3">
Nov 02 04:54:25 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 04:54:25 user nova-compute[75216]:         </nova:port>
Nov 02 04:54:25 user nova-compute[75216]:       </nova:ports>
Nov 02 04:54:25 user nova-compute[75216]:     </nova:instance>
Nov 02 04:54:25 user nova-compute[75216]:   </metadata>
Nov 02 04:54:25 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:54:25 user nova-compute[75216]:     <system>
Nov 02 04:54:25 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:54:25 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:54:25 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:54:25 user nova-compute[75216]:       <entry name="serial">709622ce-3956-4747-b274-00bb775d5fcc</entry>
Nov 02 04:54:25 user nova-compute[75216]:       <entry name="uuid">709622ce-3956-4747-b274-00bb775d5fcc</entry>
Nov 02 04:54:25 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:54:25 user nova-compute[75216]:     </system>
Nov 02 04:54:25 user nova-compute[75216]:   </sysinfo>
Nov 02 04:54:25 user nova-compute[75216]:   <os>
Nov 02 04:54:25 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:54:25 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:54:25 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:54:25 user nova-compute[75216]:   </os>
Nov 02 04:54:25 user nova-compute[75216]:   <features>
Nov 02 04:54:25 user nova-compute[75216]:     <acpi/>
Nov 02 04:54:25 user nova-compute[75216]:     <apic/>
Nov 02 04:54:25 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:54:25 user nova-compute[75216]:   </features>
Nov 02 04:54:25 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:54:25 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:54:25 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:54:25 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:54:25 user nova-compute[75216]:   </clock>
Nov 02 04:54:25 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:54:25 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:54:25 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:54:25 user nova-compute[75216]:   </cpu>
Nov 02 04:54:25 user nova-compute[75216]:   <devices>
Nov 02 04:54:25 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:54:25 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:54:25 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk"/>
Nov 02 04:54:25 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:54:25 user nova-compute[75216]:     </disk>
Nov 02 04:54:25 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:54:25 user nova-compute[75216]:       <mac address="fa:16:3e:fd:65:76"/>
Nov 02 04:54:25 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:54:25 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:54:25 user nova-compute[75216]:       <target dev="tapc90b667f-96"/>
Nov 02 04:54:25 user nova-compute[75216]:     </interface>
Nov 02 04:54:25 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:54:25 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/console.log" append="off"/>
Nov 02 04:54:25 user nova-compute[75216]:     </serial>
Nov 02 04:54:25 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:54:25 user nova-compute[75216]:     <video>
Nov 02 04:54:25 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:54:25 user nova-compute[75216]:     </video>
Nov 02 04:54:25 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:54:25 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:54:25 user nova-compute[75216]:     </rng>
Nov 02 04:54:25 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:54:25 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:54:25 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:54:25 user nova-compute[75216]:     </memballoon>
Nov 02 04:54:25 user nova-compute[75216]:   </devices>
Nov 02 04:54:25 user nova-compute[75216]: </domain>
Nov 02 04:54:25 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-597868679',display_name='tempest-AttachVolumeNegativeTest-server-597868679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-597868679',id=25,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRXCiq2yOIRdQxyJndrPOL+c/KxpbQEd3TCSp+GYgutIx9e3QQLa0mCGjYV/bi++5nJPVgD/XuCm5e0wmcuGp3amay7mZFsuINz+8xw6Sw2VKUT0zeTOfLfkokPjXOIw==',key_name='tempest-keypair-664360866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-4gtlmfur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=709622ce-3956-4747-b274-00bb775d5fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:65:76,bridge_name='br-int',has_traffic_filtering=True,id=c90b667f-9641-4074-b8b8-2cbdcd7abee3,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90b667f-96') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG os_vif [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:65:76,bridge_name='br-int',has_traffic_filtering=True,id=c90b667f-9641-4074-b8b8-2cbdcd7abee3,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90b667f-96') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4754bc3a-0ab7-535d-ba74-e7de238486a2', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc90b667f-96, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc90b667f-96, col_values=(('qos', UUID('2f757ff4-d1be-4745-bcf1-d945c0c6eb3e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc90b667f-96, col_values=(('external_ids', {'iface-id': 'c90b667f-9641-4074-b8b8-2cbdcd7abee3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:65:76', 'vm-uuid': '709622ce-3956-4747-b274-00bb775d5fcc'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:25 user nova-compute[75216]: INFO os_vif [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:65:76,bridge_name='br-int',has_traffic_filtering=True,id=c90b667f-9641-4074-b8b8-2cbdcd7abee3,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90b667f-96')
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No VIF found with MAC fa:16:3e:fd:65:76, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Updated VIF entry in instance network info cache for port c90b667f-9641-4074-b8b8-2cbdcd7abee3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Updating instance_info_cache with network_info: [{"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64799869-ccfe-4cd1-b1f0-cb782ebaf908 req-d0d4f268-ce60-4a99-9b62-38f6d6984e9e service nova] Releasing lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f3df16d-694d-45cd-8a25-5ca652fdaaa9 req-6b1e0a79-00e2-4267-90e8-44bac861f9c4 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f3df16d-694d-45cd-8a25-5ca652fdaaa9 req-6b1e0a79-00e2-4267-90e8-44bac861f9c4 service nova] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f3df16d-694d-45cd-8a25-5ca652fdaaa9 req-6b1e0a79-00e2-4267-90e8-44bac861f9c4 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f3df16d-694d-45cd-8a25-5ca652fdaaa9 req-6b1e0a79-00e2-4267-90e8-44bac861f9c4 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f3df16d-694d-45cd-8a25-5ca652fdaaa9 req-6b1e0a79-00e2-4267-90e8-44bac861f9c4 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] No waiting events found dispatching network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:27 user nova-compute[75216]: WARNING nova.compute.manager [req-7f3df16d-694d-45cd-8a25-5ca652fdaaa9 req-6b1e0a79-00e2-4267-90e8-44bac861f9c4 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received unexpected event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 for instance with vm_state building and task_state spawning.
Nov 02 04:54:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca4600c6-5481-40be-a175-0468c83d2dec req-0592953c-7fdb-4cdc-b96e-598e90b00b54 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca4600c6-5481-40be-a175-0468c83d2dec req-0592953c-7fdb-4cdc-b96e-598e90b00b54 service nova] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca4600c6-5481-40be-a175-0468c83d2dec req-0592953c-7fdb-4cdc-b96e-598e90b00b54 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca4600c6-5481-40be-a175-0468c83d2dec req-0592953c-7fdb-4cdc-b96e-598e90b00b54 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca4600c6-5481-40be-a175-0468c83d2dec req-0592953c-7fdb-4cdc-b96e-598e90b00b54 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] No waiting events found dispatching network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:29 user nova-compute[75216]: WARNING nova.compute.manager [req-ca4600c6-5481-40be-a175-0468c83d2dec req-0592953c-7fdb-4cdc-b96e-598e90b00b54 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received unexpected event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 for instance with vm_state building and task_state spawning.
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:54:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Instance spawned successfully.
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:29 user nova-compute[75216]: INFO nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:54:29 user nova-compute[75216]: INFO nova.compute.manager [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Took 7.37 seconds to build instance.
Nov 02 04:54:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-66f093ce-dcf5-4f8d-ac68-58141d840088 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.464s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:54:30 user nova-compute[75216]: INFO nova.compute.claims [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Claim successful on node user
Nov 02 04:54:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.720s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:54:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:54:30 user nova-compute[75216]: DEBUG nova.policy [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e3af262ef734b2d8a1b3208e5749fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c9027651a4044a6514c1ab0ec9ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:54:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Creating image(s)
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk 1073741824" returned: 0 in 0.061s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Successfully created port: edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.232s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Cannot resize image /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Ensure instance console log exists: /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Successfully updated port: edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquired lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-changed-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Refreshing instance network info cache due to event network-changed-edd4b05f-28d5-4af0-ba62-5f8112fbc767. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] Acquiring lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updating instance_info_cache with network_info: [{"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Releasing lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance network_info: |[{"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] Acquired lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Refreshing network info cache for port edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Start _get_guest_xml network_info=[{"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:54:32 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:32 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099158629',display_name='tempest-tempest.common.compute-instance-1099158629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099158629',id=26,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFYOuFoTYzs/OpBaoPrRjbFL2HIlbsNUljvKcH0UTQVvhrHvUp7DogNAcmNfCRZ7AXuFaF52hw+nOmVNTAC/hfKnH2b6bWCetY999y4zJb2XjnFwgLG6UqHmPtnOuruxA==',key_name='tempest-keypair-2120961819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-2saiixwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=9d70d083-152e-41b7-ac2f-bf525b92593b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:54:32 user nova-compute[75216]:   <uuid>9d70d083-152e-41b7-ac2f-bf525b92593b</uuid>
Nov 02 04:54:32 user nova-compute[75216]:   <name>instance-0000001a</name>
Nov 02 04:54:32 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:54:32 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:54:32 user nova-compute[75216]:   <metadata>
Nov 02 04:54:32 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:54:32 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:54:32 user nova-compute[75216]:       <nova:name>tempest-tempest.common.compute-instance-1099158629</nova:name>
Nov 02 04:54:32 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:54:32</nova:creationTime>
Nov 02 04:54:32 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:54:32 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:54:32 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:54:32 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:54:32 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:54:32 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:54:32 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:54:32 user nova-compute[75216]:       <nova:owner>
Nov 02 04:54:32 user nova-compute[75216]:         <nova:user uuid="7e3af262ef734b2d8a1b3208e5749fb3">tempest-ServerActionsTestOtherA-511412938-project-member</nova:user>
Nov 02 04:54:32 user nova-compute[75216]:         <nova:project uuid="597c9027651a4044a6514c1ab0ec9ad8">tempest-ServerActionsTestOtherA-511412938</nova:project>
Nov 02 04:54:32 user nova-compute[75216]:       </nova:owner>
Nov 02 04:54:32 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:54:32 user nova-compute[75216]:       <nova:ports>
Nov 02 04:54:32 user nova-compute[75216]:         <nova:port uuid="edd4b05f-28d5-4af0-ba62-5f8112fbc767">
Nov 02 04:54:32 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 04:54:32 user nova-compute[75216]:         </nova:port>
Nov 02 04:54:32 user nova-compute[75216]:       </nova:ports>
Nov 02 04:54:32 user nova-compute[75216]:     </nova:instance>
Nov 02 04:54:32 user nova-compute[75216]:   </metadata>
Nov 02 04:54:32 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:54:32 user nova-compute[75216]:     <system>
Nov 02 04:54:32 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:54:32 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:54:32 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:54:32 user nova-compute[75216]:       <entry name="serial">9d70d083-152e-41b7-ac2f-bf525b92593b</entry>
Nov 02 04:54:32 user nova-compute[75216]:       <entry name="uuid">9d70d083-152e-41b7-ac2f-bf525b92593b</entry>
Nov 02 04:54:32 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:54:32 user nova-compute[75216]:     </system>
Nov 02 04:54:32 user nova-compute[75216]:   </sysinfo>
Nov 02 04:54:32 user nova-compute[75216]:   <os>
Nov 02 04:54:32 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:54:32 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:54:32 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:54:32 user nova-compute[75216]:   </os>
Nov 02 04:54:32 user nova-compute[75216]:   <features>
Nov 02 04:54:32 user nova-compute[75216]:     <acpi/>
Nov 02 04:54:32 user nova-compute[75216]:     <apic/>
Nov 02 04:54:32 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:54:32 user nova-compute[75216]:   </features>
Nov 02 04:54:32 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:54:32 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:54:32 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:54:32 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:54:32 user nova-compute[75216]:   </clock>
Nov 02 04:54:32 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:54:32 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:54:32 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:54:32 user nova-compute[75216]:   </cpu>
Nov 02 04:54:32 user nova-compute[75216]:   <devices>
Nov 02 04:54:32 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:54:32 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:54:32 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk"/>
Nov 02 04:54:32 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:54:32 user nova-compute[75216]:     </disk>
Nov 02 04:54:32 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:54:32 user nova-compute[75216]:       <mac address="fa:16:3e:aa:fa:51"/>
Nov 02 04:54:32 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:54:32 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:54:32 user nova-compute[75216]:       <target dev="tapedd4b05f-28"/>
Nov 02 04:54:32 user nova-compute[75216]:     </interface>
Nov 02 04:54:32 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:54:32 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/console.log" append="off"/>
Nov 02 04:54:32 user nova-compute[75216]:     </serial>
Nov 02 04:54:32 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:54:32 user nova-compute[75216]:     <video>
Nov 02 04:54:32 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:54:32 user nova-compute[75216]:     </video>
Nov 02 04:54:32 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:54:32 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:54:32 user nova-compute[75216]:     </rng>
Nov 02 04:54:32 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:54:32 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:54:32 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:54:32 user nova-compute[75216]:     </memballoon>
Nov 02 04:54:32 user nova-compute[75216]:   </devices>
Nov 02 04:54:32 user nova-compute[75216]: </domain>
Nov 02 04:54:32 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099158629',display_name='tempest-tempest.common.compute-instance-1099158629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099158629',id=26,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFYOuFoTYzs/OpBaoPrRjbFL2HIlbsNUljvKcH0UTQVvhrHvUp7DogNAcmNfCRZ7AXuFaF52hw+nOmVNTAC/hfKnH2b6bWCetY999y4zJb2XjnFwgLG6UqHmPtnOuruxA==',key_name='tempest-keypair-2120961819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-2saiixwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=9d70d083-152e-41b7-ac2f-bf525b92593b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG os_vif [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82fd0a3a-9aa3-5dd3-8e62-9830699f2a1a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd4b05f-28, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedd4b05f-28, col_values=(('qos', UUID('a0487aa1-6d79-4c1b-bc01-1e8d745b8c09')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedd4b05f-28, col_values=(('external_ids', {'iface-id': 'edd4b05f-28d5-4af0-ba62-5f8112fbc767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:fa:51', 'vm-uuid': '9d70d083-152e-41b7-ac2f-bf525b92593b'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:32 user nova-compute[75216]: INFO os_vif [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28')
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:54:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No VIF found with MAC fa:16:3e:aa:fa:51, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updated VIF entry in instance network info cache for port edd4b05f-28d5-4af0-ba62-5f8112fbc767. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updating instance_info_cache with network_info: [{"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a433e91-35f0-415f-b0f7-f4bf139fb803 req-5a9dfe09-ec69-4e5d-9bdd-ee919eecddb0 service nova] Releasing lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJXBwWpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:54:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:54:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:54:33 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd817dfa-158c-4e3d-bb76-cda8ed9128c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:54:33 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0758d9c-c835-4d65-9078-8878409f685a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105] added
Nov 02 04:54:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2134cf9d-985c-4c57-bd83-369ceabda135]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b7e62-ada7-4aef-9a2c-f53de3c4bcc9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJXBwWpP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJXBwWpP" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94cd079-c816-44b4-a72e-882eb915f899]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IJXBwWpP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa82c26c-2cf1-461f-b431-42e5dba287f2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c4566c-0ef9-4400-aea4-ba2ef5120f86]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:54:33 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:54:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:54:33 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:54:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e18dc1-396f-4bda-ae57-42ff9bd29148]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260]
Nov 02 04:54:33 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260] successful.
Nov 02 04:54:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.059s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f5cd3c-f156-455d-b251-3631ea322ecb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fced290-6b78-4f55-ac0d-1b8270510251]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:54:33 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:54:33 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:54:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:54:33 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:54:33 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:54:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[316778db-7335-4f23-87f6-14d60ea9e939]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:54:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJXBwWpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-3f77f80d-4501-491e-ae5f-850d3b273094 req-f2a8dee2-bf57-4b8e-a359-4385dc1f7dfa service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f77f80d-4501-491e-ae5f-850d3b273094 req-f2a8dee2-bf57-4b8e-a359-4385dc1f7dfa service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f77f80d-4501-491e-ae5f-850d3b273094 req-f2a8dee2-bf57-4b8e-a359-4385dc1f7dfa service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f77f80d-4501-491e-ae5f-850d3b273094 req-f2a8dee2-bf57-4b8e-a359-4385dc1f7dfa service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-3f77f80d-4501-491e-ae5f-850d3b273094 req-f2a8dee2-bf57-4b8e-a359-4385dc1f7dfa service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:34 user nova-compute[75216]: WARNING nova.compute.manager [req-3f77f80d-4501-491e-ae5f-850d3b273094 req-f2a8dee2-bf57-4b8e-a359-4385dc1f7dfa service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received unexpected event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with vm_state building and task_state spawning.
Nov 02 04:54:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23963323835653464', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963323835653464', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'flavor' on Instance uuid cd78f2c7-3918-4789-9e93-fc802faef0d7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:54:34 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:54:34 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:54:34 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:54:34 user nova-compute[75216]:   <serial>37c27351-edb8-43cf-8c40-12eac36b1105</serial>
Nov 02 04:54:34 user nova-compute[75216]: </disk>
Nov 02 04:54:34 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:54:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:54:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] No VIF found with MAC fa:16:3e:fe:c8:05, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:54:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bfb599a6-7b11-49fd-b5a8-fb6ab24cba9b tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.624s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3dcc7f2-d194-4277-ba94-1dc11341b278 req-d30e4ec1-a417-4140-9d39-5e109f770fe2 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3dcc7f2-d194-4277-ba94-1dc11341b278 req-d30e4ec1-a417-4140-9d39-5e109f770fe2 service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3dcc7f2-d194-4277-ba94-1dc11341b278 req-d30e4ec1-a417-4140-9d39-5e109f770fe2 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3dcc7f2-d194-4277-ba94-1dc11341b278 req-d30e4ec1-a417-4140-9d39-5e109f770fe2 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3dcc7f2-d194-4277-ba94-1dc11341b278 req-d30e4ec1-a417-4140-9d39-5e109f770fe2 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:36 user nova-compute[75216]: WARNING nova.compute.manager [req-b3dcc7f2-d194-4277-ba94-1dc11341b278 req-d30e4ec1-a417-4140-9d39-5e109f770fe2 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received unexpected event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with vm_state building and task_state spawning.
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:54:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance spawned successfully.
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:36 user nova-compute[75216]: INFO nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 02 04:54:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:54:37 user nova-compute[75216]: INFO nova.compute.manager [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Took 7.06 seconds to build instance.
Nov 02 04:54:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-656353cd-c54e-4ce4-917c-b6e992938bc0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.492s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:54:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:54:38 user nova-compute[75216]: INFO nova.compute.claims [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Claim successful on node user
Nov 02 04:54:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:54:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:54:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.854s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:54:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:54:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:54:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:54:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:54:39 user nova-compute[75216]: DEBUG nova.policy [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae71d7b88da2452a9ec4489a0ef49176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6771c51304d446b8338d0d879ede48f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:54:39 user nova-compute[75216]: INFO nova.virt.block_device [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Booting with volume-backed-image 68d67248-2499-473c-a9cd-909ea99614c1 at /dev/vda
Nov 02 04:54:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Successfully created port: 464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Successfully updated port: 464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-changed-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Refreshing instance network info cache due to event network-changed-464a9293-b58e-4233-9747-71ecf5994bd9. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] Acquiring lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Updating instance_info_cache with network_info: [{"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance network_info: |[{"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] Acquired lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Refreshing network info cache for port 464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Updated VIF entry in instance network info cache for port 464a9293-b58e-4233-9747-71ecf5994bd9. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Updating instance_info_cache with network_info: [{"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c22032a9-4e5b-4314-82be-ce854a158c22 req-7d6cbef5-b5b8-48e9-bfd2-fc797b2d2660 service nova] Releasing lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:54:42 user nova-compute[75216]: INFO nova.compute.claims [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Claim successful on node user
Nov 02 04:54:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:54:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:54:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.policy [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf5f940bafbf4fb7aa7ace530f7d10c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baf55600ee343f2b8a6f94622bf9230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:54:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Creating image(s)
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "/opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "/opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.345s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.266s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk 1073741824" returned: 0 in 0.072s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Successfully created port: bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Cannot resize image /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Ensure instance console log exists: /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Successfully updated port: bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquired lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-changed-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Refreshing instance network info cache due to event network-changed-bb409d9e-cf0e-492d-a593-90fce1aecad8. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] Acquiring lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updating instance_info_cache with network_info: [{"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Releasing lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Instance network_info: |[{"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] Acquired lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Refreshing network info cache for port bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Start _get_guest_xml network_info=[{"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:54:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1737428131',display_name='tempest-AttachVolumeTestJSON-server-1737428131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1737428131',id=28,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm2dh7YwFgiSnlSIByUGU6F+c4UzlprOMJdliXEqEh5ZGQUkd9rSiYEVeHv6tM3xo+K6bTRAXTnd7Jc5bvQ3F607gpByK/n1LIB9EhhEVrPlYUjXsnIWC/gQ15jW7HlXA==',key_name='tempest-keypair-1281321974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-g6hpvpd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=4e6c5fe6-8947-4e54-be82-18ef5ce897f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=bb409d9e-cf0e-492d-a593-90fce1aecad8,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb409d9e-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:54:45 user nova-compute[75216]:   <uuid>4e6c5fe6-8947-4e54-be82-18ef5ce897f7</uuid>
Nov 02 04:54:45 user nova-compute[75216]:   <name>instance-0000001c</name>
Nov 02 04:54:45 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:54:45 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:54:45 user nova-compute[75216]:   <metadata>
Nov 02 04:54:45 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:54:45 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:54:45 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-1737428131</nova:name>
Nov 02 04:54:45 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:54:45</nova:creationTime>
Nov 02 04:54:45 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:54:45 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:54:45 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:54:45 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:54:45 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:54:45 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:54:45 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:54:45 user nova-compute[75216]:       <nova:owner>
Nov 02 04:54:45 user nova-compute[75216]:         <nova:user uuid="cf5f940bafbf4fb7aa7ace530f7d10c1">tempest-AttachVolumeTestJSON-1577581979-project-member</nova:user>
Nov 02 04:54:45 user nova-compute[75216]:         <nova:project uuid="8baf55600ee343f2b8a6f94622bf9230">tempest-AttachVolumeTestJSON-1577581979</nova:project>
Nov 02 04:54:45 user nova-compute[75216]:       </nova:owner>
Nov 02 04:54:45 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:54:45 user nova-compute[75216]:       <nova:ports>
Nov 02 04:54:45 user nova-compute[75216]:         <nova:port uuid="bb409d9e-cf0e-492d-a593-90fce1aecad8">
Nov 02 04:54:45 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 04:54:45 user nova-compute[75216]:         </nova:port>
Nov 02 04:54:45 user nova-compute[75216]:       </nova:ports>
Nov 02 04:54:45 user nova-compute[75216]:     </nova:instance>
Nov 02 04:54:45 user nova-compute[75216]:   </metadata>
Nov 02 04:54:45 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:54:45 user nova-compute[75216]:     <system>
Nov 02 04:54:45 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:54:45 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:54:45 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:54:45 user nova-compute[75216]:       <entry name="serial">4e6c5fe6-8947-4e54-be82-18ef5ce897f7</entry>
Nov 02 04:54:45 user nova-compute[75216]:       <entry name="uuid">4e6c5fe6-8947-4e54-be82-18ef5ce897f7</entry>
Nov 02 04:54:45 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:54:45 user nova-compute[75216]:     </system>
Nov 02 04:54:45 user nova-compute[75216]:   </sysinfo>
Nov 02 04:54:45 user nova-compute[75216]:   <os>
Nov 02 04:54:45 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:54:45 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:54:45 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:54:45 user nova-compute[75216]:   </os>
Nov 02 04:54:45 user nova-compute[75216]:   <features>
Nov 02 04:54:45 user nova-compute[75216]:     <acpi/>
Nov 02 04:54:45 user nova-compute[75216]:     <apic/>
Nov 02 04:54:45 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:54:45 user nova-compute[75216]:   </features>
Nov 02 04:54:45 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:54:45 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:54:45 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:54:45 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:54:45 user nova-compute[75216]:   </clock>
Nov 02 04:54:45 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:54:45 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:54:45 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:54:45 user nova-compute[75216]:   </cpu>
Nov 02 04:54:45 user nova-compute[75216]:   <devices>
Nov 02 04:54:45 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:54:45 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:54:45 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk"/>
Nov 02 04:54:45 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:54:45 user nova-compute[75216]:     </disk>
Nov 02 04:54:45 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:54:45 user nova-compute[75216]:       <mac address="fa:16:3e:ec:e9:31"/>
Nov 02 04:54:45 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:54:45 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:54:45 user nova-compute[75216]:       <target dev="tapbb409d9e-cf"/>
Nov 02 04:54:45 user nova-compute[75216]:     </interface>
Nov 02 04:54:45 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:54:45 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/console.log" append="off"/>
Nov 02 04:54:45 user nova-compute[75216]:     </serial>
Nov 02 04:54:45 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:54:45 user nova-compute[75216]:     <video>
Nov 02 04:54:45 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:54:45 user nova-compute[75216]:     </video>
Nov 02 04:54:45 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:54:45 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:54:45 user nova-compute[75216]:     </rng>
Nov 02 04:54:45 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:54:45 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:54:45 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:54:45 user nova-compute[75216]:     </memballoon>
Nov 02 04:54:45 user nova-compute[75216]:   </devices>
Nov 02 04:54:45 user nova-compute[75216]: </domain>
Nov 02 04:54:45 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1737428131',display_name='tempest-AttachVolumeTestJSON-server-1737428131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1737428131',id=28,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm2dh7YwFgiSnlSIByUGU6F+c4UzlprOMJdliXEqEh5ZGQUkd9rSiYEVeHv6tM3xo+K6bTRAXTnd7Jc5bvQ3F607gpByK/n1LIB9EhhEVrPlYUjXsnIWC/gQ15jW7HlXA==',key_name='tempest-keypair-1281321974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-g6hpvpd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=4e6c5fe6-8947-4e54-be82-18ef5ce897f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=bb409d9e-cf0e-492d-a593-90fce1aecad8,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb409d9e-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG os_vif [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=bb409d9e-cf0e-492d-a593-90fce1aecad8,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb409d9e-cf') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b576a52c-8209-53f8-b39a-f221692972d4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb409d9e-cf, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb409d9e-cf, col_values=(('qos', UUID('fafac572-58f9-4f81-9396-191f52f7682b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb409d9e-cf, col_values=(('external_ids', {'iface-id': 'bb409d9e-cf0e-492d-a593-90fce1aecad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:e9:31', 'vm-uuid': '4e6c5fe6-8947-4e54-be82-18ef5ce897f7'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: INFO os_vif [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=bb409d9e-cf0e-492d-a593-90fce1aecad8,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb409d9e-cf')
Nov 02 04:54:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:54:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No VIF found with MAC fa:16:3e:ec:e9:31, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:54:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updated VIF entry in instance network info cache for port bb409d9e-cf0e-492d-a593-90fce1aecad8. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:54:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updating instance_info_cache with network_info: [{"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:54:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-32921a0e-6b90-4f94-bf67-a14d5e490639 req-3bb229e5-ddcf-40a5-be92-25d85101738e service nova] Releasing lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d84625d-32f6-4b2f-9695-de8ed317287a req-684f5a9f-877c-45ea-abe2-dd4df0eb758b service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d84625d-32f6-4b2f-9695-de8ed317287a req-684f5a9f-877c-45ea-abe2-dd4df0eb758b service nova] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d84625d-32f6-4b2f-9695-de8ed317287a req-684f5a9f-877c-45ea-abe2-dd4df0eb758b service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d84625d-32f6-4b2f-9695-de8ed317287a req-684f5a9f-877c-45ea-abe2-dd4df0eb758b service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d84625d-32f6-4b2f-9695-de8ed317287a req-684f5a9f-877c-45ea-abe2-dd4df0eb758b service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] No waiting events found dispatching network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:47 user nova-compute[75216]: WARNING nova.compute.manager [req-3d84625d-32f6-4b2f-9695-de8ed317287a req-684f5a9f-877c-45ea-abe2-dd4df0eb758b service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received unexpected event network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 for instance with vm_state building and task_state spawning.
Nov 02 04:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9491cb6-40d7-4d5b-bd32-33ebe15a0605 req-53ba2270-dd81-48cd-ac35-4756ea334e47 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9491cb6-40d7-4d5b-bd32-33ebe15a0605 req-53ba2270-dd81-48cd-ac35-4756ea334e47 service nova] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9491cb6-40d7-4d5b-bd32-33ebe15a0605 req-53ba2270-dd81-48cd-ac35-4756ea334e47 service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9491cb6-40d7-4d5b-bd32-33ebe15a0605 req-53ba2270-dd81-48cd-ac35-4756ea334e47 service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9491cb6-40d7-4d5b-bd32-33ebe15a0605 req-53ba2270-dd81-48cd-ac35-4756ea334e47 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] No waiting events found dispatching network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:54:49 user nova-compute[75216]: WARNING nova.compute.manager [req-a9491cb6-40d7-4d5b-bd32-33ebe15a0605 req-53ba2270-dd81-48cd-ac35-4756ea334e47 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received unexpected event network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 for instance with vm_state building and task_state spawning.
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:54:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Instance spawned successfully.
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:54:50 user nova-compute[75216]: INFO nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Took 7.06 seconds to spawn the instance on the hypervisor.
Nov 02 04:54:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:50 user nova-compute[75216]: INFO nova.compute.manager [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Took 8.19 seconds to build instance.
Nov 02 04:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-64ed064c-93c5-4b93-a965-eff30b7ad890 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.369s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:54:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:54:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:05 user nova-compute[75216]: INFO nova.compute.manager [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Terminating instance
Nov 02 04:55:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG os_brick.utils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f933e-2290-4479-9a79-1320ead22c7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8427b69c-a4b4-4eac-abd9-948375c62f04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf670d-898f-41d3-b9c7-0f0b0b829921]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dd01db-e246-414c-bcc5-6b551a8ad120]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:55:06 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b013af2a-053b-45ba-9d0d-232b5a28bb4e]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG os_brick.utils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Updating existing volume attachment record: 28e2aa13-43a3-44ef-91fd-8ccbf2fdf628 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-8d2cfc8a-1ad2-4adb-82b4-6ee48b6e1aaa req-abb4ac03-c709-45a8-b9b2-ba998a2bb14f service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-vif-unplugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8d2cfc8a-1ad2-4adb-82b4-6ee48b6e1aaa req-abb4ac03-c709-45a8-b9b2-ba998a2bb14f service nova] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8d2cfc8a-1ad2-4adb-82b4-6ee48b6e1aaa req-abb4ac03-c709-45a8-b9b2-ba998a2bb14f service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8d2cfc8a-1ad2-4adb-82b4-6ee48b6e1aaa req-abb4ac03-c709-45a8-b9b2-ba998a2bb14f service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-8d2cfc8a-1ad2-4adb-82b4-6ee48b6e1aaa req-abb4ac03-c709-45a8-b9b2-ba998a2bb14f service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] No waiting events found dispatching network-vif-unplugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-8d2cfc8a-1ad2-4adb-82b4-6ee48b6e1aaa req-abb4ac03-c709-45a8-b9b2-ba998a2bb14f service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-vif-unplugged-07462512-5214-4591-9a71-ba1994ef82d2 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:55:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Instance destroyed successfully.
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lazy-loading 'resources' on Instance uuid a61cce9f-24a3-4538-be2d-30b562825a16 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1848345043',display_name='tempest-VolumesAdminNegativeTest-server-1848345043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1848345043',id=14,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTvrrN+s5BBkQbObCpyQAlVCGkB7seKQEJ9eQvvT5TIu/3hhD8mr6NAGOfU1WRj6OLsnn8Kp4QqhNVxl0xxTwmD3TV8OevU0Al0SLnvtJwyqgHPeFK/W6ojAy783UkYbg==',key_name='tempest-keypair-447207878',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78fab3926a14516be58c49540110c07',ramdisk_id='',reservation_id='r-s6ngfjsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1191324499',owner_user_name='tempest-VolumesAdminNegativeTest-1191324499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62b4c824a20b4980adda4a3821b28e3c',uuid=a61cce9f-24a3-4538-be2d-30b562825a16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converting VIF {"id": "07462512-5214-4591-9a71-ba1994ef82d2", "address": "fa:16:3e:50:58:97", "network": {"id": "20e9d991-8e94-422a-b203-f801404b24dd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-913143359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78fab3926a14516be58c49540110c07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07462512-52", "ovs_interfaceid": "07462512-5214-4591-9a71-ba1994ef82d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:58:97,bridge_name='br-int',has_traffic_filtering=True,id=07462512-5214-4591-9a71-ba1994ef82d2,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07462512-52') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG os_vif [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:58:97,bridge_name='br-int',has_traffic_filtering=True,id=07462512-5214-4591-9a71-ba1994ef82d2,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07462512-52') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07462512-52, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dff96d39-9ad3-4c6d-ab3c-1b89731d8583) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:06 user nova-compute[75216]: INFO os_vif [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:58:97,bridge_name='br-int',has_traffic_filtering=True,id=07462512-5214-4591-9a71-ba1994ef82d2,network=Network(20e9d991-8e94-422a-b203-f801404b24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07462512-52')
Nov 02 04:55:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Deleting instance files /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16_del
Nov 02 04:55:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Deletion of /opt/stack/data/nova/instances/a61cce9f-24a3-4538-be2d-30b562825a16_del complete
Nov 02 04:55:06 user nova-compute[75216]: INFO nova.compute.manager [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 02 04:55:06 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:55:06 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:55:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:07 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:07 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Took 1.07 seconds to deallocate network for instance.
Nov 02 04:55:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a3f7b21-af56-43d9-8edf-c2581dd3eba4 req-de94d538-58d7-4d83-af37-987201f356ab service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-vif-deleted-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:07 user nova-compute[75216]: INFO nova.compute.manager [req-1a3f7b21-af56-43d9-8edf-c2581dd3eba4 req-de94d538-58d7-4d83-af37-987201f356ab service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Neutron deleted interface 07462512-5214-4591-9a71-ba1994ef82d2; detaching it from the instance and deleting it from the info cache
Nov 02 04:55:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-1a3f7b21-af56-43d9-8edf-c2581dd3eba4 req-de94d538-58d7-4d83-af37-987201f356ab service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a3f7b21-af56-43d9-8edf-c2581dd3eba4 req-de94d538-58d7-4d83-af37-987201f356ab service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Detach interface failed, port_id=07462512-5214-4591-9a71-ba1994ef82d2, reason: Instance a61cce9f-24a3-4538-be2d-30b562825a16 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:55:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-94764ee5-1c0d-4311-ba8b-e5393b58f2f2 req-23913020-0bdc-429d-947b-61fc812d9398 service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received event network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94764ee5-1c0d-4311-ba8b-e5393b58f2f2 req-23913020-0bdc-429d-947b-61fc812d9398 service nova] Acquiring lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94764ee5-1c0d-4311-ba8b-e5393b58f2f2 req-23913020-0bdc-429d-947b-61fc812d9398 service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94764ee5-1c0d-4311-ba8b-e5393b58f2f2 req-23913020-0bdc-429d-947b-61fc812d9398 service nova] Lock "a61cce9f-24a3-4538-be2d-30b562825a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-94764ee5-1c0d-4311-ba8b-e5393b58f2f2 req-23913020-0bdc-429d-947b-61fc812d9398 service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] No waiting events found dispatching network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:08 user nova-compute[75216]: WARNING nova.compute.manager [req-94764ee5-1c0d-4311-ba8b-e5393b58f2f2 req-23913020-0bdc-429d-947b-61fc812d9398 service nova] [instance: a61cce9f-24a3-4538-be2d-30b562825a16] Received unexpected event network-vif-plugged-07462512-5214-4591-9a71-ba1994ef82d2 for instance with vm_state deleted and task_state None.
Nov 02 04:55:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:08 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Deleted allocations for instance a61cce9f-24a3-4538-be2d-30b562825a16
Nov 02 04:55:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d8b3c7a4-4f27-439e-8ee5-25dda376afa1 tempest-VolumesAdminNegativeTest-1191324499 tempest-VolumesAdminNegativeTest-1191324499-project-member] Lock "a61cce9f-24a3-4538-be2d-30b562825a16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.097s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:10 user nova-compute[75216]: INFO nova.compute.manager [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Terminating instance
Nov 02 04:55:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-25ae96e3-3080-46ea-8fed-066d73e3c9b5 req-5fec754a-fe80-4d85-a729-bf258598b299 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-unplugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25ae96e3-3080-46ea-8fed-066d73e3c9b5 req-5fec754a-fe80-4d85-a729-bf258598b299 service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25ae96e3-3080-46ea-8fed-066d73e3c9b5 req-5fec754a-fe80-4d85-a729-bf258598b299 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-25ae96e3-3080-46ea-8fed-066d73e3c9b5 req-5fec754a-fe80-4d85-a729-bf258598b299 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-25ae96e3-3080-46ea-8fed-066d73e3c9b5 req-5fec754a-fe80-4d85-a729-bf258598b299 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-unplugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-25ae96e3-3080-46ea-8fed-066d73e3c9b5 req-5fec754a-fe80-4d85-a729-bf258598b299 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-unplugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Instance destroyed successfully.
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lazy-loading 'resources' on Instance uuid b785aebc-d26d-4976-ab5a-4d9a3255df6f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1856802463',display_name='tempest-ServersNegativeTestJSON-server-1856802463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1856802463',id=22,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11a39d43d2e4623884c15e26cc0641e',ramdisk_id='',reservation_id='r-rl01j4bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1245791276',owner_user_name='tempest-ServersNegativeTestJSON-1245791276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:53:28Z,user_data=None,user_id='123248b36fe94f2ebf8a2cb77d1b30cd',uuid=b785aebc-d26d-4976-ab5a-4d9a3255df6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converting VIF {"id": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "address": "fa:16:3e:f2:f0:e8", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e939ca8-b4", "ovs_interfaceid": "9e939ca8-b499-4e30-993d-5f6e1b10a040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9e939ca8-b499-4e30-993d-5f6e1b10a040,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e939ca8-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG os_vif [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9e939ca8-b499-4e30-993d-5f6e1b10a040,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e939ca8-b4') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e939ca8-b4, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bc2d284-431c-41af-9571-7738ed1560e3) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: INFO os_vif [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9e939ca8-b499-4e30-993d-5f6e1b10a040,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e939ca8-b4')
Nov 02 04:55:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Deleting instance files /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f_del
Nov 02 04:55:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Deletion of /opt/stack/data/nova/instances/b785aebc-d26d-4976-ab5a-4d9a3255df6f_del complete
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: INFO nova.compute.manager [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:11 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Took 0.62 seconds to deallocate network for instance.
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-13f394dc-6e0b-40bc-9d69-427f751b15e2 req-2fb9e5b1-69cc-49f2-a2d1-228ace27f44d service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-deleted-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:11 user nova-compute[75216]: INFO nova.compute.manager [req-13f394dc-6e0b-40bc-9d69-427f751b15e2 req-2fb9e5b1-69cc-49f2-a2d1-228ace27f44d service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Neutron deleted interface 9e939ca8-b499-4e30-993d-5f6e1b10a040; detaching it from the instance and deleting it from the info cache
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-13f394dc-6e0b-40bc-9d69-427f751b15e2 req-2fb9e5b1-69cc-49f2-a2d1-228ace27f44d service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-13f394dc-6e0b-40bc-9d69-427f751b15e2 req-2fb9e5b1-69cc-49f2-a2d1-228ace27f44d service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Detach interface failed, port_id=9e939ca8-b499-4e30-993d-5f6e1b10a040, reason: Instance b785aebc-d26d-4976-ab5a-4d9a3255df6f could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:12 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Deleted allocations for instance b785aebc-d26d-4976-ab5a-4d9a3255df6f
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0ec455f-ab64-4c0a-8e75-c07fa3c2c883 tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:12 user nova-compute[75216]: WARNING nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received unexpected event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with vm_state deleted and task_state None.
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:12 user nova-compute[75216]: WARNING nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received unexpected event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with vm_state deleted and task_state None.
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:12 user nova-compute[75216]: WARNING nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received unexpected event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with vm_state deleted and task_state None.
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-unplugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-unplugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:12 user nova-compute[75216]: WARNING nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received unexpected event network-vif-unplugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with vm_state deleted and task_state None.
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Acquiring lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] Lock "b785aebc-d26d-4976-ab5a-4d9a3255df6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] No waiting events found dispatching network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:12 user nova-compute[75216]: WARNING nova.compute.manager [req-96cea1ed-7c44-4a03-a454-eb6e062f976d req-28e24a63-c637-4d85-88c6-58a0f1c44663 service nova] [instance: b785aebc-d26d-4976-ab5a-4d9a3255df6f] Received unexpected event network-vif-plugged-9e939ca8-b499-4e30-993d-5f6e1b10a040 for instance with vm_state deleted and task_state None.
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:55:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:55:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7113MB free_disk=24.9049072265625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance cd78f2c7-3918-4789-9e93-fc802faef0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance bf29e71d-bdea-49a2-9640-5fb7bc9ff72f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 709622ce-3956-4747-b274-00bb775d5fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9d70d083-152e-41b7-ac2f-bf525b92593b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 48c33b8f-cdd5-452e-9c39-3e5504db6b1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:55:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:55:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 04:55:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Skipping network cache update for instance because it is Building. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 3b055742-c605-41ab-bd40-1a777b8f4e39 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updating instance_info_cache with network_info: [{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:55:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:55:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:55:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Creating image(s)
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Ensure instance console log exists: /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Start _get_guest_xml network_info=[{"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '28e2aa13-43a3-44ef-91fd-8ccbf2fdf628', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUGKjhEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48c33b8f-cdd5-452e-9c39-3e5504db6b1f', 'attached_at': '', 'detached_at': '', 'volume_id': '6fb11303-8f48-490e-86f7-f904a2fe33b4', 'serial': '6fb11303-8f48-490e-86f7-f904a2fe33b4'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:55:26 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:55:26 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUGKjhEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:55:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:55:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:55:26 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5c2a13-3e3a-4baa-befb-e287615bfe7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:55:26 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24117c8f-779a-427a-a77d-b6db9f559edb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4] added
Nov 02 04:55:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45005b1a-9d00-4525-b5a8-564e4f07cf0e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3446bae-dbfd-4c02-8cf6-79127cd14491]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUGKjhEg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUGKjhEg" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f5a855-8cdc-474c-90e4-48de32b4b67c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZUGKjhEg'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a8285-c2fb-425b-ae2d-485d64381d08]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd391b-e831-47e7-a842-2d9e49145a99]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:26 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:55:26 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:26 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:55:26 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing instance network info cache due to event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG nova.network.neutron [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.136s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f7a51-23ce-4f51-a22b-bc59f2325814]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260]
Nov 02 04:55:27 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260] successful.
Nov 02 04:55:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67601223-5538-4c16-9b5c-3d62dd565955]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67890d1e-f23d-409d-bb73-06504f197fa3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:27 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:55:27 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:27 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:27 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:55:27 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:27 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63def439-85fc-41ca-b195-da15967608be]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUGKjhEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:27 user nova-compute[75216]: INFO nova.compute.manager [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Shelve offloading
Nov 02 04:55:27 user nova-compute[75216]: DEBUG nova.network.neutron [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updated VIF entry in instance network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG nova.network.neutron [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0990c777-ad1c-44aa-b29a-c1653d8d98c9 req-09c5dd8b-cdea-4402-8742-4a0ca0369c16 service nova] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-2671d6a0-f854-4c84-b3ed-67274d6c07c4 req-553a9fc9-aaf3-4b22-9c4e-5683c189bf15 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2671d6a0-f854-4c84-b3ed-67274d6c07c4 req-553a9fc9-aaf3-4b22-9c4e-5683c189bf15 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2671d6a0-f854-4c84-b3ed-67274d6c07c4 req-553a9fc9-aaf3-4b22-9c4e-5683c189bf15 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2671d6a0-f854-4c84-b3ed-67274d6c07c4 req-553a9fc9-aaf3-4b22-9c4e-5683c189bf15 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-2671d6a0-f854-4c84-b3ed-67274d6c07c4 req-553a9fc9-aaf3-4b22-9c4e-5683c189bf15 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:28 user nova-compute[75216]: WARNING nova.compute.manager [req-2671d6a0-f854-4c84-b3ed-67274d6c07c4 req-553a9fc9-aaf3-4b22-9c4e-5683c189bf15 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state active and task_state shelving.
Nov 02 04:55:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23437623533346464', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437623533346464', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413566755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413566755',id=27,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-k1ojyas8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:40Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=48c33b8f-cdd5-452e-9c39-3e5504db6b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'pci_devices' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:55:28 user nova-compute[75216]:   <uuid>48c33b8f-cdd5-452e-9c39-3e5504db6b1f</uuid>
Nov 02 04:55:28 user nova-compute[75216]:   <name>instance-0000001b</name>
Nov 02 04:55:28 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:55:28 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:55:28 user nova-compute[75216]:   <metadata>
Nov 02 04:55:28 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:55:28 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:55:28 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-413566755</nova:name>
Nov 02 04:55:28 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:55:26</nova:creationTime>
Nov 02 04:55:28 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:55:28 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:55:28 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:55:28 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:55:28 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:55:28 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:55:28 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:55:28 user nova-compute[75216]:       <nova:owner>
Nov 02 04:55:28 user nova-compute[75216]:         <nova:user uuid="ae71d7b88da2452a9ec4489a0ef49176">tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member</nova:user>
Nov 02 04:55:28 user nova-compute[75216]:         <nova:project uuid="f6771c51304d446b8338d0d879ede48f">tempest-ServerBootFromVolumeStableRescueTest-1501080447</nova:project>
Nov 02 04:55:28 user nova-compute[75216]:       </nova:owner>
Nov 02 04:55:28 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:55:28 user nova-compute[75216]:       <nova:ports>
Nov 02 04:55:28 user nova-compute[75216]:         <nova:port uuid="464a9293-b58e-4233-9747-71ecf5994bd9">
Nov 02 04:55:28 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 04:55:28 user nova-compute[75216]:         </nova:port>
Nov 02 04:55:28 user nova-compute[75216]:       </nova:ports>
Nov 02 04:55:28 user nova-compute[75216]:     </nova:instance>
Nov 02 04:55:28 user nova-compute[75216]:   </metadata>
Nov 02 04:55:28 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:55:28 user nova-compute[75216]:     <system>
Nov 02 04:55:28 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:55:28 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:55:28 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:55:28 user nova-compute[75216]:       <entry name="serial">48c33b8f-cdd5-452e-9c39-3e5504db6b1f</entry>
Nov 02 04:55:28 user nova-compute[75216]:       <entry name="uuid">48c33b8f-cdd5-452e-9c39-3e5504db6b1f</entry>
Nov 02 04:55:28 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:55:28 user nova-compute[75216]:     </system>
Nov 02 04:55:28 user nova-compute[75216]:   </sysinfo>
Nov 02 04:55:28 user nova-compute[75216]:   <os>
Nov 02 04:55:28 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:55:28 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:55:28 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:55:28 user nova-compute[75216]:   </os>
Nov 02 04:55:28 user nova-compute[75216]:   <features>
Nov 02 04:55:28 user nova-compute[75216]:     <acpi/>
Nov 02 04:55:28 user nova-compute[75216]:     <apic/>
Nov 02 04:55:28 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:55:28 user nova-compute[75216]:   </features>
Nov 02 04:55:28 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:55:28 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:55:28 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:55:28 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:55:28 user nova-compute[75216]:   </clock>
Nov 02 04:55:28 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:55:28 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:55:28 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:55:28 user nova-compute[75216]:   </cpu>
Nov 02 04:55:28 user nova-compute[75216]:   <devices>
Nov 02 04:55:28 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:55:28 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:55:28 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 02 04:55:28 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:55:28 user nova-compute[75216]:       <serial>6fb11303-8f48-490e-86f7-f904a2fe33b4</serial>
Nov 02 04:55:28 user nova-compute[75216]:     </disk>
Nov 02 04:55:28 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:55:28 user nova-compute[75216]:       <mac address="fa:16:3e:1c:3a:87"/>
Nov 02 04:55:28 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:55:28 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:55:28 user nova-compute[75216]:       <target dev="tap464a9293-b5"/>
Nov 02 04:55:28 user nova-compute[75216]:     </interface>
Nov 02 04:55:28 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:55:28 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/console.log" append="off"/>
Nov 02 04:55:28 user nova-compute[75216]:     </serial>
Nov 02 04:55:28 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:55:28 user nova-compute[75216]:     <video>
Nov 02 04:55:28 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:55:28 user nova-compute[75216]:     </video>
Nov 02 04:55:28 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:55:28 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:55:28 user nova-compute[75216]:     </rng>
Nov 02 04:55:28 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:55:28 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:55:28 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:55:28 user nova-compute[75216]:     </memballoon>
Nov 02 04:55:28 user nova-compute[75216]:   </devices>
Nov 02 04:55:28 user nova-compute[75216]: </domain>
Nov 02 04:55:28 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413566755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413566755',id=27,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-k1ojyas8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:54:40Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=48c33b8f-cdd5-452e-9c39-3e5504db6b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG os_vif [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7429d104-e3f9-5e3b-a7e0-285d69712803', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap464a9293-b5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap464a9293-b5, col_values=(('qos', UUID('770f853d-ca2b-4126-bd65-9dd850a4c2bd')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap464a9293-b5, col_values=(('external_ids', {'iface-id': '464a9293-b58e-4233-9747-71ecf5994bd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:3a:87', 'vm-uuid': '48c33b8f-cdd5-452e-9c39-3e5504db6b1f'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: INFO os_vif [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5')
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No VIF found with MAC fa:16:3e:1c:3a:87, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance destroyed successfully.
Nov 02 04:55:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:30 user nova-compute[75216]: WARNING nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state active and task_state shelving.
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:30 user nova-compute[75216]: WARNING nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state active and task_state shelving.
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:30 user nova-compute[75216]: WARNING nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state active and task_state shelving.
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:30 user nova-compute[75216]: WARNING nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state active and task_state shelving.
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:30 user nova-compute[75216]: WARNING nova.compute.manager [req-03279a05-b961-4bb7-bd80-a7f0f57d9d3f req-2c7f1a44-e10a-4ce0-bdcc-7ef21ac2a1c3 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state active and task_state shelving.
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance destroyed successfully.
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'resources' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1658344299',display_name='tempest-TestShelveInstance-server-1658344299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1658344299',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR2e7O3g+/yfvhFEGDrml2dxdAl7kHa14iolyIEUwDVIRS7NkIFi50QeWJpS40VrFqitAVFd7y/IHiVBAniowp1ZvmQoZ5SWx6/ECJfuV/DKXNxdNFoSJPIaNuhvrkMmg==',key_name='tempest-TestShelveInstance-1286148874',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f36dd21f3ea4792a9b68ed89eb31a58',ramdisk_id='',reservation_id='r-zkw0auwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1358632032',owner_user_name='tempest-TestShelveInstance-1358632032-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:54:03Z,user_data=None,user_id='e2cc45316cf74e649bdf7d88cf460c6e',uuid=bf29e71d-bdea-49a2-9640-5fb7bc9ff72f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converting VIF {"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_vif [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa399f62c-e5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bed9db97-f736-4d32-a664-8669025179f1) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: INFO os_vif [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5')
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:55:30 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c2939-c291-4258-a938-32c7e7f160cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:55:30 user nova-compute[75216]: No targets found.
Nov 02 04:55:30 user nova-compute[75216]: iSNS:
Nov 02 04:55:30 user nova-compute[75216]: No targets found.
Nov 02 04:55:30 user nova-compute[75216]: STATIC:
Nov 02 04:55:30 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:55:30 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:55:30 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:55:30 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac
Nov 02 04:55:30 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:55:30 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:55:30 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:55:30 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:55:30 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:55:30 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105
Nov 02 04:55:30 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:55:30 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:55:30 user nova-compute[75216]: FIRMWARE:
Nov 02 04:55:30 user nova-compute[75216]: No targets found.
Nov 02 04:55:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:55:30 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:55:30 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[996fbf3a-2c88-4915-9669-c0690a4656de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[871b1d9b-5d21-493e-ab5b-fb567404ac5f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:30 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:55:30 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:30 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:30 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:55:30 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:30 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec435c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f3cc31-a84f-4406-8d66-9aff38e1271c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40d5078-809c-44ce-80ae-75f9fd1b6a50]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af84640-2b8c-4e76-bfb0-3573a18f0fae]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85d987d-f7ab-4dcb-a0a1-af0980f033e7]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca7567-7628-4ddf-9b9d-68144013de48]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d75a2e8-071d-41ea-97f2-1f0b7b3f2e27]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]
Nov 02 04:55:30 user nova-compute[75216]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.
Nov 02 04:55:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3193eba-0f99-4f6b-8314-7c9e299a91eb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] <== disconnect_volume: return (331ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:55:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:55:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Deleting instance files /opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f_del
Nov 02 04:55:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Deletion of /opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f_del complete
Nov 02 04:55:32 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Deleted allocations for instance bf29e71d-bdea-49a2-9640-5fb7bc9ff72f
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:32 user nova-compute[75216]: WARNING nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state building and task_state spawning.
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing instance network info cache due to event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'numa_topology' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.objects.base [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Object Instance<bf29e71d-bdea-49a2-9640-5fb7bc9ff72f> lazy-loaded attributes: resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:55:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance spawned successfully.
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:32 user nova-compute[75216]: INFO nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7992fe5-9996-446c-9dc5-15843eff43bd tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.968s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updated VIF entry in instance network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": null, "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa399f62c-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:55:32 user nova-compute[75216]: WARNING nova.compute.manager [req-03293d74-d065-4f89-8b2c-93df6849502f req-79e1615f-aa35-4af9-8384-af6f76968803 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state building and task_state spawning.
Nov 02 04:55:32 user nova-compute[75216]: INFO nova.compute.manager [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Took 54.39 seconds to build instance.
Nov 02 04:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9cd24225-aa74-41ce-94d8-bf7b4a50c509 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.506s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'flavor' on Instance uuid b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:33 user nova-compute[75216]: INFO nova.compute.manager [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Attaching volume 320d8d50-1e5d-460b-97f2-ac73a18edf22 to /dev/vdb
Nov 02 04:55:33 user nova-compute[75216]: DEBUG os_brick.utils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb372a4-a0ac-43c9-a425-4bad5bb1c558]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fb118-1a89-42a4-9909-ecbed20188dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f02834-d1e7-4b66-981a-793ae870be1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc52eb87-b7bc-47ff-8cef-5bdaaee8176a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:55:33 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b50e453-109b-42cb-ae2a-73a6c0921477]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG os_brick.utils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:55:33 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updating existing volume attachment record: 8fc8752b-e0c5-4134-9687-c48face533ed {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-changed-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Refreshing instance network info cache due to event network-changed-96c0f432-9445-4f6b-b01a-a6eec6b776ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] Acquiring lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] Acquired lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Refreshing network info cache for port 96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updated VIF entry in instance network info cache for port 96c0f432-9445-4f6b-b01a-a6eec6b776ec. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updating instance_info_cache with network_info: [{"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-873a5b20-f533-4016-9306-433663e7b380 req-d5561a22-07a5-4690-8392-727354d100ed service nova] Releasing lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:55:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:44 user nova-compute[75216]: INFO nova.compute.manager [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Detaching volume 37c27351-edb8-43cf-8c40-12eac36b1105
Nov 02 04:55:44 user nova-compute[75216]: INFO nova.virt.block_device [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Attempting to driver detach volume 37c27351-edb8-43cf-8c40-12eac36b1105 from mountpoint /dev/vdb
Nov 02 04:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Attempting to detach device vdb from instance cd78f2c7-3918-4789-9e93-fc802faef0d7 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:55:44 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:55:44 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:55:44 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:55:44 user nova-compute[75216]:   <serial>37c27351-edb8-43cf-8c40-12eac36b1105</serial>
Nov 02 04:55:44 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:55:44 user nova-compute[75216]: </disk>
Nov 02 04:55:44 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:55:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Successfully detached device vdb from instance cd78f2c7-3918-4789-9e93-fc802faef0d7 from the persistent domain config.
Nov 02 04:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd78f2c7-3918-4789-9e93-fc802faef0d7 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:55:44 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:55:44 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:55:44 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:55:44 user nova-compute[75216]:   <serial>37c27351-edb8-43cf-8c40-12eac36b1105</serial>
Nov 02 04:55:44 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:55:44 user nova-compute[75216]: </disk>
Nov 02 04:55:44 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:55:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd78f2c7-3918-4789-9e93-fc802faef0d7 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:55:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIsSOMFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:55:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:55:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:55:53 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc885b-bd42-42da-9094-be6d8cb85f62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:55:53 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0980cd6-d681-4490-ac0f-3d7f70583aa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22] added
Nov 02 04:55:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0151c6-b872-44f9-9ff0-0dd4714a4c9e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[108db50d-35c6-4cb5-aa9e-619688066a16]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIsSOMFa {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIsSOMFa" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf45cf4-75d0-4e4f-a6af-fbae73a27ff1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIsSOMFa'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa477fe9-25e0-45bb-baeb-bbc3c359f04c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e7014-1f4e-48c4-89c2-b3f836089ba6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[360242ee-6921-4608-b764-ef06ba18547d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260]
Nov 02 04:55:53 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260] successful.
Nov 02 04:55:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b540016-4a43-4433-ae88-b88d950acc0f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c88daa-8b1b-4cde-b568-b46a9ff4aa22]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:55:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:55:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:55:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c5be2-d6f8-4abd-91ea-5b7e79a095b1]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:55:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:55:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIsSOMFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23332346232303966', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332346232303966', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'flavor' on Instance uuid b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:55:55 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:55:55 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:55:55 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:55:55 user nova-compute[75216]:   <serial>320d8d50-1e5d-460b-97f2-ac73a18edf22</serial>
Nov 02 04:55:55 user nova-compute[75216]: </disk>
Nov 02 04:55:55 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] No VIF found with MAC fa:16:3e:05:a3:f7, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9271c16e-71eb-4104-bb1c-6adb69f26c90 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.366s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:55:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:55:57 user nova-compute[75216]: INFO nova.compute.manager [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Detaching volume 320d8d50-1e5d-460b-97f2-ac73a18edf22
Nov 02 04:55:57 user nova-compute[75216]: INFO nova.virt.block_device [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Attempting to driver detach volume 320d8d50-1e5d-460b-97f2-ac73a18edf22 from mountpoint /dev/vdb
Nov 02 04:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Attempting to detach device vdb from instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:55:57 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:55:57 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:55:57 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:55:57 user nova-compute[75216]:   <serial>320d8d50-1e5d-460b-97f2-ac73a18edf22</serial>
Nov 02 04:55:57 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:55:57 user nova-compute[75216]: </disk>
Nov 02 04:55:57 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:55:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully detached device vdb from instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 from the persistent domain config.
Nov 02 04:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:55:57 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:55:57 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:55:57 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:55:57 user nova-compute[75216]:   <serial>320d8d50-1e5d-460b-97f2-ac73a18edf22</serial>
Nov 02 04:55:57 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:55:57 user nova-compute[75216]: </disk>
Nov 02 04:55:57 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:04 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd78f2c7-3918-4789-9e93-fc802faef0d7 is timed out.
Nov 02 04:56:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Successfully detached device vdb from instance cd78f2c7-3918-4789-9e93-fc802faef0d7 from the live domain config.
Nov 02 04:56:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJXBwWpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:05 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d78a1b1-16e1-4f33-a03c-56a9c1c4f414]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:56:05 user nova-compute[75216]: No targets found.
Nov 02 04:56:05 user nova-compute[75216]: iSNS:
Nov 02 04:56:05 user nova-compute[75216]: No targets found.
Nov 02 04:56:05 user nova-compute[75216]: STATIC:
Nov 02 04:56:05 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22
Nov 02 04:56:05 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:05 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:05 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:56:05 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:05 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:05 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:56:05 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:05 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:05 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105
Nov 02 04:56:05 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:05 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:05 user nova-compute[75216]: FIRMWARE:
Nov 02 04:56:05 user nova-compute[75216]: No targets found.
Nov 02 04:56:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:56:05 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:56:05 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1369ec-86ce-477c-bf8a-5e3e044476b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fdd7fb-9f01-4449-80d3-53121e60bf64]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:56:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec435e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e213dfe-0898-4639-ab07-f4b575e7eba3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c97ea-1299-41f0-8a26-82f920785097]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a651d0-c70a-4f9b-9a66-22da24b894d8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae827fb-eed1-4b54-829e-fa94be46bbf2]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c521797-72f9-4646-99cd-59a33be88275]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b3008-3d4f-4220-819c-3cee08c9cc71]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260]
Nov 02 04:56:05 user nova-compute[75216]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105, portal: 172.16.0.220,3260] successful.
Nov 02 04:56:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f1a461-81ff-45e1-badf-8aede10b49d6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] <== disconnect_volume: return (300ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'flavor' on Instance uuid cd78f2c7-3918-4789-9e93-fc802faef0d7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8b23785-f0c0-43e0-b8ef-f6dc248fd3e8 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.138s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.010s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:06 user nova-compute[75216]: INFO nova.compute.manager [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Terminating instance
Nov 02 04:56:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0e363b7-48c1-4bab-b9b6-b38dc05387df req-0c4a5d4c-b22c-44d4-99bf-c394ec6afa68 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-vif-unplugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0e363b7-48c1-4bab-b9b6-b38dc05387df req-0c4a5d4c-b22c-44d4-99bf-c394ec6afa68 service nova] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0e363b7-48c1-4bab-b9b6-b38dc05387df req-0c4a5d4c-b22c-44d4-99bf-c394ec6afa68 service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0e363b7-48c1-4bab-b9b6-b38dc05387df req-0c4a5d4c-b22c-44d4-99bf-c394ec6afa68 service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0e363b7-48c1-4bab-b9b6-b38dc05387df req-0c4a5d4c-b22c-44d4-99bf-c394ec6afa68 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] No waiting events found dispatching network-vif-unplugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0e363b7-48c1-4bab-b9b6-b38dc05387df req-0c4a5d4c-b22c-44d4-99bf-c394ec6afa68 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-vif-unplugged-8582f3c6-de9c-4add-948d-a266f54b5753 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:56:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Instance destroyed successfully.
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'resources' on Instance uuid cd78f2c7-3918-4789-9e93-fc802faef0d7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-158936682',display_name='tempest-VolumesSnapshotTestJSON-instance-158936682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-158936682',id=21,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD35V0o6euWsrucM32tc9WaI1ZG+w3egZg9N0L7xYHUGU2gm0Y5UI6Jri3cNmK5CojISAvEcc3o9lModv7Mx6pX9L4pgKBknyUwhujZeLi+UQFatCqJichNrSVF01YMXpw==',key_name='tempest-keypair-1603375135',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65b49d78b7cd47db8284e82230b2237f',ramdisk_id='',reservation_id='r-8aber8gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1815478259',owner_user_name='tempest-VolumesSnapshotTestJSON-1815478259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:52:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c01f25553f947d781c9c8b8a0953203',uuid=cd78f2c7-3918-4789-9e93-fc802faef0d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converting VIF {"id": "8582f3c6-de9c-4add-948d-a266f54b5753", "address": "fa:16:3e:fe:c8:05", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8582f3c6-de", "ovs_interfaceid": "8582f3c6-de9c-4add-948d-a266f54b5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=8582f3c6-de9c-4add-948d-a266f54b5753,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8582f3c6-de') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_vif [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=8582f3c6-de9c-4add-948d-a266f54b5753,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8582f3c6-de') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8582f3c6-de, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef36a8b0-86a0-43f0-b25d-51adf2db03f4) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:07 user nova-compute[75216]: INFO os_vif [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=8582f3c6-de9c-4add-948d-a266f54b5753,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8582f3c6-de')
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJXBwWpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:07 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[260b5784-619c-4bb2-851d-a8cdf40ae206]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:56:07 user nova-compute[75216]: No targets found.
Nov 02 04:56:07 user nova-compute[75216]: iSNS:
Nov 02 04:56:07 user nova-compute[75216]: No targets found.
Nov 02 04:56:07 user nova-compute[75216]: STATIC:
Nov 02 04:56:07 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22
Nov 02 04:56:07 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:07 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:07 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:56:07 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:07 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:07 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:56:07 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:07 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:07 user nova-compute[75216]: FIRMWARE:
Nov 02 04:56:07 user nova-compute[75216]: No targets found.
Nov 02 04:56:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:56:07 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:56:07 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c27351-edb8-43cf-8c40-12eac36b1105', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c5d1a-4e8a-4cc4-9f81-f6e17c53c22c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c1c14-7e2b-47d1-a27a-4a743f8fa7fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:07 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:07 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:56:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:07 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:07 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:56:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460413d090>, {}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Disconnecting from: [] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] <== disconnect_volume: return (74ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:56:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Deleting instance files /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7_del
Nov 02 04:56:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Deletion of /opt/stack/data/nova/instances/cd78f2c7-3918-4789-9e93-fc802faef0d7_del complete
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:07 user nova-compute[75216]: INFO nova.compute.manager [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 02 04:56:07 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:56:07 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:08 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Took 0.89 seconds to deallocate network for instance.
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-d5aa692c-4b4d-4246-89b9-5fe7bb8e9203 req-1f9c1ca0-56ca-4978-a40b-6d834df8b2e4 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-vif-deleted-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:08 user nova-compute[75216]: INFO nova.compute.manager [req-d5aa692c-4b4d-4246-89b9-5fe7bb8e9203 req-1f9c1ca0-56ca-4978-a40b-6d834df8b2e4 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Neutron deleted interface 8582f3c6-de9c-4add-948d-a266f54b5753; detaching it from the instance and deleting it from the info cache
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-d5aa692c-4b4d-4246-89b9-5fe7bb8e9203 req-1f9c1ca0-56ca-4978-a40b-6d834df8b2e4 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:08 user nova-compute[75216]: WARNING nova.volume.cinder [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Attachment 8a2b12cf-d6ef-468c-8f23-65f8146751ed does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8a2b12cf-d6ef-468c-8f23-65f8146751ed. (HTTP 404) (Request-ID: req-4daaeefb-6771-481d-a2b8-945d9b79be0b)
Nov 02 04:56:08 user nova-compute[75216]: INFO nova.compute.manager [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Took 0.03 seconds to detach 1 volumes for instance.
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-d5aa692c-4b4d-4246-89b9-5fe7bb8e9203 req-1f9c1ca0-56ca-4978-a40b-6d834df8b2e4 service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Detach interface failed, port_id=8582f3c6-de9c-4add-948d-a266f54b5753, reason: Instance cd78f2c7-3918-4789-9e93-fc802faef0d7 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-09b4f6c4-4942-4659-966a-e580f827ad62 req-df0c574e-dadb-4285-9a5f-b561f1d2248f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received event network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-09b4f6c4-4942-4659-966a-e580f827ad62 req-df0c574e-dadb-4285-9a5f-b561f1d2248f service nova] Acquiring lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-09b4f6c4-4942-4659-966a-e580f827ad62 req-df0c574e-dadb-4285-9a5f-b561f1d2248f service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-09b4f6c4-4942-4659-966a-e580f827ad62 req-df0c574e-dadb-4285-9a5f-b561f1d2248f service nova] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-09b4f6c4-4942-4659-966a-e580f827ad62 req-df0c574e-dadb-4285-9a5f-b561f1d2248f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] No waiting events found dispatching network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:08 user nova-compute[75216]: WARNING nova.compute.manager [req-09b4f6c4-4942-4659-966a-e580f827ad62 req-df0c574e-dadb-4285-9a5f-b561f1d2248f service nova] [instance: cd78f2c7-3918-4789-9e93-fc802faef0d7] Received unexpected event network-vif-plugged-8582f3c6-de9c-4add-948d-a266f54b5753 for instance with vm_state deleted and task_state None.
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:08 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Deleted allocations for instance cd78f2c7-3918-4789-9e93-fc802faef0d7
Nov 02 04:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d7490b5e-419f-427a-b50c-423ed70f6502 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "cd78f2c7-3918-4789-9e93-fc802faef0d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.519s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-changed-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Refreshing instance network info cache due to event network-changed-c90b667f-9641-4074-b8b8-2cbdcd7abee3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] Acquiring lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] Acquired lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Refreshing network info cache for port c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:56:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG nova.network.neutron [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Updated VIF entry in instance network info cache for port c90b667f-9641-4074-b8b8-2cbdcd7abee3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG nova.network.neutron [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Updating instance_info_cache with network_info: [{"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3ffc37d-1c33-47fb-8657-b89107d0db99 req-c43aea09-6d16-4ac8-85c5-7c2dc3cb9e87 service nova] Releasing lock "refresh_cache-709622ce-3956-4747-b274-00bb775d5fcc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:15 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:56:15 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7356MB free_disk=24.918750762939453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 709622ce-3956-4747-b274-00bb775d5fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9d70d083-152e-41b7-ac2f-bf525b92593b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 48c33b8f-cdd5-452e-9c39-3e5504db6b1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:56:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:16 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:56:16 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:56:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:56:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:56:17 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 is timed out.
Nov 02 04:56:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully detached device vdb from instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 from the live domain config.
Nov 02 04:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIsSOMFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:17 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating instance_info_cache with network_info: [{"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-43182725-9f83-4afd-a243-49d838e7d811" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5bd905-4d8d-4888-a0fa-6833df07eb95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:56:17 user nova-compute[75216]: No targets found.
Nov 02 04:56:17 user nova-compute[75216]: iSNS:
Nov 02 04:56:17 user nova-compute[75216]: No targets found.
Nov 02 04:56:17 user nova-compute[75216]: STATIC:
Nov 02 04:56:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22
Nov 02 04:56:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:56:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:56:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:17 user nova-compute[75216]: FIRMWARE:
Nov 02 04:56:17 user nova-compute[75216]: No targets found.
Nov 02 04:56:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:56:17 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:56:17 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6caae5-e113-41c6-b848-953bf5df6963]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aaf414-f502-46db-99e5-9dfe5bc3735c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:17 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:17 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:56:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:17 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:17 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 (non-flash)
Nov 02 04:56:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec4351b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87dcaca-b045-4d5e-ac52-da1fcf4d51bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30457cb5-716a-462a-9343-0bba5103f6eb]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67984d54-5283-44a7-8004-5ea8ed15c158]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff784c5-7d55-4a68-ae54-430d05454ad8]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bea5d62-06b8-40b1-9b13-22bf7a6ee5ea]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44db301-f6cf-4860-8a6f-7e21c7a044e2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260]
Nov 02 04:56:17 user nova-compute[75216]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22, portal: 172.16.0.220,3260] successful.
Nov 02 04:56:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:320d8d50-1e5d-460b-97f2-ac73a18edf22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90db514-dce1-4158-b6d3-1aca5c629466]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] <== disconnect_volume: return (300ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'flavor' on Instance uuid b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid 709622ce-3956-4747-b274-00bb775d5fcc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d439d5e5-cb1b-4e03-adc9-bb67efe3f8e9 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.139s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:19 user nova-compute[75216]: INFO nova.compute.manager [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Attaching volume fed40311-d54e-4204-aa60-e21843e149d3 to /dev/vdb
Nov 02 04:56:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dcc0de-846c-4f7b-a303-e2c10ee64cd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97609a4-0b3f-41e8-8047-a536375f9fc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6ed7e-e765-4870-8ce5-b997c0090ee9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6152ff2c-d6c7-41df-b126-11cc0edc212f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:56:19 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:56:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b4d85e-f36a-4b5d-bac2-4966c7fc86ff]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Updating existing volume attachment record: 5d7fea07-183a-4bcf-a1de-695703cc8697 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:56:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-changed-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Refreshing instance network info cache due to event network-changed-edd4b05f-28d5-4af0-ba62-5f8112fbc767. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] Acquiring lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] Acquired lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Refreshing network info cache for port edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updated VIF entry in instance network info cache for port edd4b05f-28d5-4af0-ba62-5f8112fbc767. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updating instance_info_cache with network_info: [{"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc8f4fb7-d054-41f0-95f5-33d895eb815e req-5d662a05-fad1-4816-9a6a-49905fd1e803 service nova] Releasing lock "refresh_cache-9d70d083-152e-41b7-ac2f-bf525b92593b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'flavor' on Instance uuid 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:22 user nova-compute[75216]: INFO nova.compute.manager [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Attaching volume 5a6f2bf0-953c-4d34-9cbc-c9ef15802626 to /dev/vdb
Nov 02 04:56:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG os_brick.utils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d7ea4-9dfe-481e-9098-50c0eb8a2e88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44a942b-f753-4a66-b7be-ebbbe1017bed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9d938b-04be-4576-90b2-527f1e6d8914]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b16d0-4c24-4498-af9a-102e06365560]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:56:22 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:56:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7739f351-414d-45db-8fe0-ddebf444d8d9]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG os_brick.utils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:22 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updating existing volume attachment record: 3c60f0c9-1b24-4a74-9104-6f5c74ed0f76 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:56:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-changed-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Refreshing instance network info cache due to event network-changed-bb409d9e-cf0e-492d-a593-90fce1aecad8. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:56:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] Acquiring lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:56:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] Acquired lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:56:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Refreshing network info cache for port bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:56:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updated VIF entry in instance network info cache for port bb409d9e-cf0e-492d-a593-90fce1aecad8. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:56:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updating instance_info_cache with network_info: [{"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-949b6829-d50f-48b8-aaf2-43e7ace1c1c1 req-b8028471-b8f1-46c6-80db-77b66f51259c service nova] Releasing lock "refresh_cache-4e6c5fe6-8947-4e54-be82-18ef5ce897f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:56:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:40 user nova-compute[75216]: INFO nova.compute.manager [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Attaching volume 4c275706-92e9-49cb-b68c-5305d1572b3c to /dev/vdb
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.utils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0631e04-1c0d-4ea6-bc51-598e4209f1e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf22fa-cf74-410c-8ac3-e6ab2cf0ba51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[06100bd8-62d9-4ee4-8f60-d60a5ef9902e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe91e49-2d0a-44e2-8e77-8476580eea5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:56:40 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a987027e-8d04-4e64-950b-94b2c4094736]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.utils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updating existing volume attachment record: c1b4b0fe-71ac-4693-b614-b2723c6722ff {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvKYcrOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:40 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:40 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:40 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce1f056-e203-4b76-a7ca-bbad3602d7e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:56:40 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fce789-ad86-4189-b264-0656e6333267]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3] added
Nov 02 04:56:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1e56bb-099e-4e9d-938b-c194fdfe7b20]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ad7812-9080-4658-9ac3-d6e3ac8d5e82]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvKYcrOE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvKYcrOE" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[547cac04-2ee8-4e0a-8e2d-1eb78064967c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvKYcrOE'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fecf19-ea1c-4f0f-83c7-447bf6191ae4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82908407-6c23-43f6-b552-74cfd9f15bbd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb452066-90b7-4b70-9b71-4798bad36bbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260]
Nov 02 04:56:40 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260] successful.
Nov 02 04:56:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[235d6e5b-7007-427f-b6c9-f11dcadc4564]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8cb3c1-35a8-4578-afa9-67a1d076ec2d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83083bd5-3313-4f2a-8708-7cd2e4f76ce2]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:56:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:56:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvKYcrOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:56:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23062393930653765', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062393930653765', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:56:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid 709622ce-3956-4747-b274-00bb775d5fcc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:56:41 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:56:41 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:56:41 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:56:41 user nova-compute[75216]:   <serial>fed40311-d54e-4204-aa60-e21843e149d3</serial>
Nov 02 04:56:41 user nova-compute[75216]: </disk>
Nov 02 04:56:41 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:56:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:56:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:56:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] No VIF found with MAC fa:16:3e:fd:65:76, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:56:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4b8b8d3-07c4-44be-8d5f-0fbe109aa718 tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.008s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:43 user nova-compute[75216]: INFO nova.compute.manager [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Detaching volume fed40311-d54e-4204-aa60-e21843e149d3
Nov 02 04:56:44 user nova-compute[75216]: INFO nova.virt.block_device [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Attempting to driver detach volume fed40311-d54e-4204-aa60-e21843e149d3 from mountpoint /dev/vdb
Nov 02 04:56:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Attempting to detach device vdb from instance 709622ce-3956-4747-b274-00bb775d5fcc from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:56:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:56:44 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:56:44 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:56:44 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:56:44 user nova-compute[75216]:   <serial>fed40311-d54e-4204-aa60-e21843e149d3</serial>
Nov 02 04:56:44 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:56:44 user nova-compute[75216]: </disk>
Nov 02 04:56:44 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:56:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully detached device vdb from instance 709622ce-3956-4747-b274-00bb775d5fcc from the persistent domain config.
Nov 02 04:56:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 709622ce-3956-4747-b274-00bb775d5fcc from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:56:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:56:44 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:56:44 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:56:44 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:56:44 user nova-compute[75216]:   <serial>fed40311-d54e-4204-aa60-e21843e149d3</serial>
Nov 02 04:56:44 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:56:44 user nova-compute[75216]: </disk>
Nov 02 04:56:44 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:56:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 709622ce-3956-4747-b274-00bb775d5fcc {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:56:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-changed-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Refreshing instance network info cache due to event network-changed-96c0f432-9445-4f6b-b01a-a6eec6b776ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] Acquiring lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] Acquired lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Refreshing network info cache for port 96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:47 user nova-compute[75216]: INFO nova.compute.manager [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Terminating instance
Nov 02 04:56:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updated VIF entry in instance network info cache for port 96c0f432-9445-4f6b-b01a-a6eec6b776ec. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updating instance_info_cache with network_info: [{"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ead3c43-af68-4a1b-abfe-a8e875724720 req-ca2eba01-1649-40f5-ac4e-8181efc13d94 service nova] Releasing lock "refresh_cache-b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Instance destroyed successfully.
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'resources' on Instance uuid b94b3e13-fcc7-45b1-a60f-14f12be9b7f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1842006615',display_name='tempest-TestStampPattern-server-1842006615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1842006615',id=24,image_ref='925d1afa-124f-4df5-bb18-a2548b5d4379',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsRzP3Sg+sJdhvi68MNNzT62rX+Rvtkulq7b2aqFAXRvz/PCDywk8i0/3Qn3hw8DO0i8lgHEo5/PcGZcK4FS6lQGDpD4OwaBWQCg1f0tC4Nct4Wx2de+2XNa4rN9Rx48A==',key_name='tempest-TestStampPattern-2044657716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6b5ff67267c443b81b9472b5d5560ab',ramdisk_id='',reservation_id='r-jyn0g99k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5da51a4a-9605-4c02-b3cb-367fafba296f',image_min_disk='1',image_min_ram='0',image_owner_id='d6b5ff67267c443b81b9472b5d5560ab',image_owner_project_name='tempest-TestStampPattern-774067185',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-774067185-project-member',image_user_id='2e06c15a638245d2825317e30721ebd1',owner_project_name='tempest-TestStampPattern-774067185',owner_user_name='tempest-TestStampPattern-774067185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:53:48Z,user_data=None,user_id='2e06c15a638245d2825317e30721ebd1',uuid=b94b3e13-fcc7-45b1-a60f-14f12be9b7f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converting VIF {"id": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "address": "fa:16:3e:05:a3:f7", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c0f432-94", "ovs_interfaceid": "96c0f432-9445-4f6b-b01a-a6eec6b776ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=96c0f432-9445-4f6b-b01a-a6eec6b776ec,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c0f432-94') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG os_vif [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=96c0f432-9445-4f6b-b01a-a6eec6b776ec,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c0f432-94') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96c0f432-94, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=809bd8e9-1f86-486f-af49-9f55ca99ef9d) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: INFO os_vif [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=96c0f432-9445-4f6b-b01a-a6eec6b776ec,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c0f432-94')
Nov 02 04:56:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Deleting instance files /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0_del
Nov 02 04:56:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Deletion of /opt/stack/data/nova/instances/b94b3e13-fcc7-45b1-a60f-14f12be9b7f0_del complete
Nov 02 04:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:48 user nova-compute[75216]: INFO nova.compute.manager [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 02 04:56:48 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:56:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-unplugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] No waiting events found dispatching network-vif-unplugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-unplugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] No waiting events found dispatching network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:49 user nova-compute[75216]: WARNING nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received unexpected event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec for instance with vm_state active and task_state deleting.
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] No waiting events found dispatching network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:49 user nova-compute[75216]: WARNING nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received unexpected event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec for instance with vm_state active and task_state deleting.
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] No waiting events found dispatching network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:49 user nova-compute[75216]: WARNING nova.compute.manager [req-c68b476a-87ea-4a97-a645-5f21d2e328b3 req-55ee96eb-5df2-4aae-8bd8-162e6db1a0c0 service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received unexpected event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec for instance with vm_state active and task_state deleting.
Nov 02 04:56:49 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:56:49 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Took 1.02 seconds to deallocate network for instance.
Nov 02 04:56:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:50 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:56:50 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:56:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:50 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Deleted allocations for instance b94b3e13-fcc7-45b1-a60f-14f12be9b7f0
Nov 02 04:56:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b8aafb4b-bb64-4a8e-af3e-b68bdd3c8618 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-0eab5a14-8815-4a02-ad0e-4d8b8fa06f48 req-a4ba9915-4b2b-4cb2-a940-03c0b22609fb service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0eab5a14-8815-4a02-ad0e-4d8b8fa06f48 req-a4ba9915-4b2b-4cb2-a940-03c0b22609fb service nova] Acquiring lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0eab5a14-8815-4a02-ad0e-4d8b8fa06f48 req-a4ba9915-4b2b-4cb2-a940-03c0b22609fb service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0eab5a14-8815-4a02-ad0e-4d8b8fa06f48 req-a4ba9915-4b2b-4cb2-a940-03c0b22609fb service nova] Lock "b94b3e13-fcc7-45b1-a60f-14f12be9b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-0eab5a14-8815-4a02-ad0e-4d8b8fa06f48 req-a4ba9915-4b2b-4cb2-a940-03c0b22609fb service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] No waiting events found dispatching network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:51 user nova-compute[75216]: WARNING nova.compute.manager [req-0eab5a14-8815-4a02-ad0e-4d8b8fa06f48 req-a4ba9915-4b2b-4cb2-a940-03c0b22609fb service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received unexpected event network-vif-plugged-96c0f432-9445-4f6b-b01a-a6eec6b776ec for instance with vm_state deleted and task_state None.
Nov 02 04:56:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-0eab5a14-8815-4a02-ad0e-4d8b8fa06f48 req-a4ba9915-4b2b-4cb2-a940-03c0b22609fb service nova] [instance: b94b3e13-fcc7-45b1-a60f-14f12be9b7f0] Received event network-vif-deleted-96c0f432-9445-4f6b-b01a-a6eec6b776ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:53 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[554d44ac-b5d4-44ae-8eab-2dc0e5ea7fcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:56:53 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[28250df4-bcf6-42f9-94cf-0c3d95ae64cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626] added
Nov 02 04:56:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8b12b-4c2e-4535-b6fc-76d37e8ce3e1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60a491-d7ff-4a41-a608-f0c57d56dc00]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwWoeamZ {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwWoeamZ" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[28979300-6f4a-4af8-b5d1-effd100d9234]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwWoeamZ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca78b8-5e12-4542-9cd2-b9c32cddaaba]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[107ab3f9-7c14-42dc-a384-7c57012a3035]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81be9694-463d-407f-b255-d30e98b89865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]
Nov 02 04:56:53 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.
Nov 02 04:56:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5ebe79-c1fd-4058-b90b-e24e1416d702]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9224b5ab-163b-43bc-aace-e88e5279087d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:56:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d98440-29e3-4150-aa0b-2aef0ab58534]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:56:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23733306563643834', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733306563643834', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'flavor' on Instance uuid 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:56:54 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:56:54 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:56:54 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:56:54 user nova-compute[75216]:   <serial>5a6f2bf0-953c-4d34-9cbc-c9ef15802626</serial>
Nov 02 04:56:54 user nova-compute[75216]: </disk>
Nov 02 04:56:54 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:56:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No VIF found with MAC fa:16:3e:aa:fa:51, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:56:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a5d01d41-5a8e-44a0-9e33-19680e6182e4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.902s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:56 user nova-compute[75216]: INFO nova.compute.manager [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Rebuilding instance
Nov 02 04:56:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-3f0ce0fd-f0e6-4c2d-827e-0ecc148b31ca req-51f656ef-df41-433c-b7be-a623afae6b27 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-unplugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f0ce0fd-f0e6-4c2d-827e-0ecc148b31ca req-51f656ef-df41-433c-b7be-a623afae6b27 service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f0ce0fd-f0e6-4c2d-827e-0ecc148b31ca req-51f656ef-df41-433c-b7be-a623afae6b27 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f0ce0fd-f0e6-4c2d-827e-0ecc148b31ca req-51f656ef-df41-433c-b7be-a623afae6b27 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-3f0ce0fd-f0e6-4c2d-827e-0ecc148b31ca req-51f656ef-df41-433c-b7be-a623afae6b27 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-unplugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:57 user nova-compute[75216]: WARNING nova.compute.manager [req-3f0ce0fd-f0e6-4c2d-827e-0ecc148b31ca req-51f656ef-df41-433c-b7be-a623afae6b27 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received unexpected event network-vif-unplugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with vm_state active and task_state rebuilding.
Nov 02 04:56:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance destroyed successfully.
Nov 02 04:56:57 user nova-compute[75216]: INFO nova.compute.manager [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Detaching volume 5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:56:57 user nova-compute[75216]: INFO nova.virt.block_device [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Attempting to driver detach volume 5a6f2bf0-953c-4d34-9cbc-c9ef15802626 from mountpoint /dev/vdb
Nov 02 04:56:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Attempting to detach device vdb from instance 9d70d083-152e-41b7-ac2f-bf525b92593b from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:56:57 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:56:57 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:56:57 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:56:57 user nova-compute[75216]:   <serial>5a6f2bf0-953c-4d34-9cbc-c9ef15802626</serial>
Nov 02 04:56:57 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:56:57 user nova-compute[75216]: </disk>
Nov 02 04:56:57 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:56:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully detached device vdb from instance 9d70d083-152e-41b7-ac2f-bf525b92593b from the persistent domain config.
Nov 02 04:56:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:56:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02d0064-0c59-41f8-9dca-fa061b532e37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:56:57 user nova-compute[75216]: No targets found.
Nov 02 04:56:57 user nova-compute[75216]: iSNS:
Nov 02 04:56:57 user nova-compute[75216]: No targets found.
Nov 02 04:56:57 user nova-compute[75216]: STATIC:
Nov 02 04:56:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3
Nov 02 04:56:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:57 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:56:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:57 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:56:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:57 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:56:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:57 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:57 user nova-compute[75216]: FIRMWARE:
Nov 02 04:56:57 user nova-compute[75216]: No targets found.
Nov 02 04:56:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:56:57 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:56:57 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:56:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c34b8b-765b-429a-a87a-c2a493576568]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c2565e-106b-4337-a17a-2c94a14fdb65]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:56:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec342710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd332077-2868-438e-885f-a0a473d805ee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67ded58-fd6c-4908-ba00-ad46e525633c]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8bca77-9dbc-4127-8398-50eb3ad0cfad]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d3e237-96a0-4f59-94f0-98420274d207]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a4a21-ff8c-4982-8f49-1431c6ee811a]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1edcf96-a3f3-469f-a30b-bbd5cf2f3a86]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]
Nov 02 04:56:58 user nova-compute[75216]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.
Nov 02 04:56:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b32a5b-d974-4730-93da-71c675aa7f54]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== disconnect_volume: return (340ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:56:58 user nova-compute[75216]: INFO nova.compute.claims [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Claim successful on node user
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:56:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:56:58 user nova-compute[75216]: DEBUG nova.policy [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bf03434f876400e97a796e0eece6587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf742c02eeb2451e85993430c7d36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:56:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Creating image(s)
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "/opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "/opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "/opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance destroyed successfully.
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099158629',display_name='tempest-ServerActionsTestOtherA-server-1648751664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099158629',id=26,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFYOuFoTYzs/OpBaoPrRjbFL2HIlbsNUljvKcH0UTQVvhrHvUp7DogNAcmNfCRZ7AXuFaF52hw+nOmVNTAC/hfKnH2b6bWCetY999y4zJb2XjnFwgLG6UqHmPtnOuruxA==',key_name='tempest-keypair-2120961819',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-2saiixwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=9d70d083-152e-41b7-ac2f-bf525b92593b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_vif [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd4b05f-28, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0487aa1-6d79-4c1b-bc01-1e8d745b8c09) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:56:59 user nova-compute[75216]: INFO os_vif [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28')
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:56:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcd584e-2ec3-43e0-836b-872471c52790]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:56:59 user nova-compute[75216]: No targets found.
Nov 02 04:56:59 user nova-compute[75216]: iSNS:
Nov 02 04:56:59 user nova-compute[75216]: No targets found.
Nov 02 04:56:59 user nova-compute[75216]: STATIC:
Nov 02 04:56:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3
Nov 02 04:56:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:59 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:56:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:59 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:56:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:56:59 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:56:59 user nova-compute[75216]: FIRMWARE:
Nov 02 04:56:59 user nova-compute[75216]: No targets found.
Nov 02 04:56:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:56:59 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:56:59 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-925dfb15-13e0-4399-8552-ac8f023ae537 req-e31d4b70-ab77-48ac-a025-f13c7fd11155 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-925dfb15-13e0-4399-8552-ac8f023ae537 req-e31d4b70-ab77-48ac-a025-f13c7fd11155 service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-925dfb15-13e0-4399-8552-ac8f023ae537 req-e31d4b70-ab77-48ac-a025-f13c7fd11155 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-925dfb15-13e0-4399-8552-ac8f023ae537 req-e31d4b70-ab77-48ac-a025-f13c7fd11155 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-925dfb15-13e0-4399-8552-ac8f023ae537 req-e31d4b70-ab77-48ac-a025-f13c7fd11155 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:56:59 user nova-compute[75216]: WARNING nova.compute.manager [req-925dfb15-13e0-4399-8552-ac8f023ae537 req-e31d4b70-ab77-48ac-a025-f13c7fd11155 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received unexpected event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with vm_state active and task_state rebuilding.
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk 1073741824" returned: 0 in 0.088s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03953735-c709-4f68-ae79-1f198d5eb12d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Successfully created port: ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe298ec7-6008-4b09-93d6-cd5fd24ce457]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:59 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:59 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:56:59 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:56:59 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:56:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f461041b250>, {}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Disconnecting from: [] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.209s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== disconnect_volume: return (211ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:56:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Deleting instance files /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b_del
Nov 02 04:56:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Deletion of /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b_del complete
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:56:59 user nova-compute[75216]: INFO nova.virt.block_device [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Booting with volume 5a6f2bf0-953c-4d34-9cbc-c9ef15802626 at /dev/vdb
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Cannot resize image /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Ensure instance console log exists: /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG os_brick.utils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d07e27-73aa-4b7d-9ff0-17415609e9c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef3ee8b-fddd-4491-98f0-785944115463]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ff0ba4-d593-40c5-bd2e-487b7dd7ee55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c61e15-5de2-4da3-a8fb-1ce0e7618be3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:00 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75321bf1-8eca-44c1-a5e6-59dc507b4e79]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG os_brick.utils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updating existing volume attachment record: e940e10f-1cbf-4082-bbaf-5eb3c1efd776 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Successfully updated port: ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquired lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:57:00 user nova-compute[75216]: INFO nova.compute.claims [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Claim successful on node user
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Updating instance_info_cache with network_info: [{"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Releasing lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Instance network_info: |[{"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Start _get_guest_xml network_info=[{"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-844889376',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-844889376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8448893',id=29,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEdfM/wSubA6Ve8/9bgwY4q7WkGY0sfMrMT4uICzZ/wSVQI8Tdw5SFRDcPT7gs9angeRaeQjAek5FrrofEtcLrk+WaV3i6fx4XS+SHILyLMsR8zaJC8XMUIlLU7oclOnA==',key_name='tempest-keypair-1132889921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf742c02eeb2451e85993430c7d36267',ramdisk_id='',reservation_id='r-alvldvx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-902550122',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bf03434f876400e97a796e0eece6587',uuid=838dfbb6-38e1-40b0-8c70-31ce4953e285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Converting VIF {"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:53:0c,bridge_name='br-int',has_traffic_filtering=True,id=ed2f7db0-4989-4640-96c5-b651054973f7,network=Network(bb6eb2a8-45e0-4ed2-bcca-414a49330bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2f7db0-49') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.objects.instance [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lazy-loading 'pci_devices' on Instance uuid 838dfbb6-38e1-40b0-8c70-31ce4953e285 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:57:00 user nova-compute[75216]:   <uuid>838dfbb6-38e1-40b0-8c70-31ce4953e285</uuid>
Nov 02 04:57:00 user nova-compute[75216]:   <name>instance-0000001d</name>
Nov 02 04:57:00 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:57:00 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:57:00 user nova-compute[75216]:   <metadata>
Nov 02 04:57:00 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:57:00 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:57:00 user nova-compute[75216]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-844889376</nova:name>
Nov 02 04:57:00 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:57:00</nova:creationTime>
Nov 02 04:57:00 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:57:00 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:57:00 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:57:00 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:57:00 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:57:00 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:57:00 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:57:00 user nova-compute[75216]:       <nova:owner>
Nov 02 04:57:00 user nova-compute[75216]:         <nova:user uuid="9bf03434f876400e97a796e0eece6587">tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member</nova:user>
Nov 02 04:57:00 user nova-compute[75216]:         <nova:project uuid="cf742c02eeb2451e85993430c7d36267">tempest-TestServerVolumeAttachScenarioOldVersion-902550122</nova:project>
Nov 02 04:57:00 user nova-compute[75216]:       </nova:owner>
Nov 02 04:57:00 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:57:00 user nova-compute[75216]:       <nova:ports>
Nov 02 04:57:00 user nova-compute[75216]:         <nova:port uuid="ed2f7db0-4989-4640-96c5-b651054973f7">
Nov 02 04:57:00 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 04:57:00 user nova-compute[75216]:         </nova:port>
Nov 02 04:57:00 user nova-compute[75216]:       </nova:ports>
Nov 02 04:57:00 user nova-compute[75216]:     </nova:instance>
Nov 02 04:57:00 user nova-compute[75216]:   </metadata>
Nov 02 04:57:00 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:57:00 user nova-compute[75216]:     <system>
Nov 02 04:57:00 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:57:00 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:57:00 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:57:00 user nova-compute[75216]:       <entry name="serial">838dfbb6-38e1-40b0-8c70-31ce4953e285</entry>
Nov 02 04:57:00 user nova-compute[75216]:       <entry name="uuid">838dfbb6-38e1-40b0-8c70-31ce4953e285</entry>
Nov 02 04:57:00 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:57:00 user nova-compute[75216]:     </system>
Nov 02 04:57:00 user nova-compute[75216]:   </sysinfo>
Nov 02 04:57:00 user nova-compute[75216]:   <os>
Nov 02 04:57:00 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:57:00 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:57:00 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:57:00 user nova-compute[75216]:   </os>
Nov 02 04:57:00 user nova-compute[75216]:   <features>
Nov 02 04:57:00 user nova-compute[75216]:     <acpi/>
Nov 02 04:57:00 user nova-compute[75216]:     <apic/>
Nov 02 04:57:00 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:57:00 user nova-compute[75216]:   </features>
Nov 02 04:57:00 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:57:00 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:57:00 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:57:00 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:57:00 user nova-compute[75216]:   </clock>
Nov 02 04:57:00 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:57:00 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:57:00 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:57:00 user nova-compute[75216]:   </cpu>
Nov 02 04:57:00 user nova-compute[75216]:   <devices>
Nov 02 04:57:00 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:57:00 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:57:00 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk"/>
Nov 02 04:57:00 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:57:00 user nova-compute[75216]:     </disk>
Nov 02 04:57:00 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:57:00 user nova-compute[75216]:       <mac address="fa:16:3e:01:53:0c"/>
Nov 02 04:57:00 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:00 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:57:00 user nova-compute[75216]:       <target dev="taped2f7db0-49"/>
Nov 02 04:57:00 user nova-compute[75216]:     </interface>
Nov 02 04:57:00 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:57:00 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/console.log" append="off"/>
Nov 02 04:57:00 user nova-compute[75216]:     </serial>
Nov 02 04:57:00 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:57:00 user nova-compute[75216]:     <video>
Nov 02 04:57:00 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:00 user nova-compute[75216]:     </video>
Nov 02 04:57:00 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:57:00 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:57:00 user nova-compute[75216]:     </rng>
Nov 02 04:57:00 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:57:00 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:57:00 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:57:00 user nova-compute[75216]:     </memballoon>
Nov 02 04:57:00 user nova-compute[75216]:   </devices>
Nov 02 04:57:00 user nova-compute[75216]: </domain>
Nov 02 04:57:00 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-844889376',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-844889376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8448893',id=29,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEdfM/wSubA6Ve8/9bgwY4q7WkGY0sfMrMT4uICzZ/wSVQI8Tdw5SFRDcPT7gs9angeRaeQjAek5FrrofEtcLrk+WaV3i6fx4XS+SHILyLMsR8zaJC8XMUIlLU7oclOnA==',key_name='tempest-keypair-1132889921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf742c02eeb2451e85993430c7d36267',ramdisk_id='',reservation_id='r-alvldvx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-902550122',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bf03434f876400e97a796e0eece6587',uuid=838dfbb6-38e1-40b0-8c70-31ce4953e285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Converting VIF {"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:53:0c,bridge_name='br-int',has_traffic_filtering=True,id=ed2f7db0-4989-4640-96c5-b651054973f7,network=Network(bb6eb2a8-45e0-4ed2-bcca-414a49330bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2f7db0-49') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG os_vif [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:53:0c,bridge_name='br-int',has_traffic_filtering=True,id=ed2f7db0-4989-4640-96c5-b651054973f7,network=Network(bb6eb2a8-45e0-4ed2-bcca-414a49330bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2f7db0-49') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c862379-0d90-5046-846e-9a39c4557de5', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped2f7db0-49, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped2f7db0-49, col_values=(('qos', UUID('5a49fd79-4c1c-4e30-b32f-51c4a2062434')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped2f7db0-49, col_values=(('external_ids', {'iface-id': 'ed2f7db0-4989-4640-96c5-b651054973f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:53:0c', 'vm-uuid': '838dfbb6-38e1-40b0-8c70-31ce4953e285'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:01 user nova-compute[75216]: INFO os_vif [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:53:0c,bridge_name='br-int',has_traffic_filtering=True,id=ed2f7db0-4989-4640-96c5-b651054973f7,network=Network(bb6eb2a8-45e0-4ed2-bcca-414a49330bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2f7db0-49')
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] No VIF found with MAC fa:16:3e:01:53:0c, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.776s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:57:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:57:01 user nova-compute[75216]: INFO nova.virt.block_device [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Booting with volume 23e0ecc7-7922-425d-b28c-e95ff1eae48a at /dev/vda
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-changed-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Refreshing instance network info cache due to event network-changed-ed2f7db0-4989-4640-96c5-b651054973f7. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] Acquiring lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] Acquired lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Refreshing network info cache for port ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG os_brick.utils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.policy [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0647ffce9f894d59ac9bd8509c79393b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94946efcb3b4b49967b47d62446269c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[25306837-1e02-4a9b-bbdd-467fb89cfad4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81a451-261f-4963-9eec-eeb8156fc718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d46fd6-a77b-4142-b970-24c6da859873]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b5558-a0c4-4830-ba18-9a6dae63a5d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:01 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:57:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5f3302-01f3-4a06-bcd2-3cf5748118b5]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG os_brick.utils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:01 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating existing volume attachment record: 4f4c202e-7808-4e6c-bc09-54e6c2fc15a9 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Updated VIF entry in instance network info cache for port ed2f7db0-4989-4640-96c5-b651054973f7. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Updating instance_info_cache with network_info: [{"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-493387c4-31d8-40de-b3b2-65839e576525 req-0cdb5c2a-1a6e-4ab0-bb89-8f31b31817e2 service nova] Releasing lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully created port: 61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anroElvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:02 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:02 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:02 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5562c82c-a1f1-4711-95d1-3a1ef0dd1000]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:57:02 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb4121-2b52-4d25-ade8-153e6c3f6d45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c] added
Nov 02 04:57:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b378a7-2c34-487b-a34a-be0dcbb1de84]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa89b2-b16f-4871-9814-f5fc15dd8a29]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anroElvw {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anroElvw" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f51262a-f03e-408b-9e1f-4e116b4b76f1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anroElvw'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab066f33-fec8-4541-9395-16f35c24f8ec]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6fbd60-a24f-4ed6-9726-f26109181d74]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:02 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:02 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:57:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:02 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:02 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:57:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3252e4-b06a-4e6b-af5d-d3cffb3796ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260]
Nov 02 04:57:03 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260] successful.
Nov 02 04:57:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3b9be9-9428-49fe-9fd9-144fbc53394d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b212c2df-99bd-4480-a4fd-6e59de684c78]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:03 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:03 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:57:03 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:03 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:03 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:57:03 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a152d07f-60a6-4573-b85f-5c118e8efafb]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully created port: a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] No waiting events found dispatching network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:03 user nova-compute[75216]: WARNING nova.compute.manager [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received unexpected event network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 for instance with vm_state building and task_state spawning.
Nov 02 04:57:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] No waiting events found dispatching network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:03 user nova-compute[75216]: WARNING nova.compute.manager [req-d9db2de6-4e5d-4c4a-9777-69adf7a26665 req-c699af34-d4be-45f7-8f7b-ba46208b1bec service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received unexpected event network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 for instance with vm_state building and task_state spawning.
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anroElvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26531323539663065', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531323539663065', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully created port: 849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:57:04 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:57:04 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:57:04 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:57:04 user nova-compute[75216]:   <serial>4c275706-92e9-49cb-b68c-5305d1572b3c</serial>
Nov 02 04:57:04 user nova-compute[75216]: </disk>
Nov 02 04:57:04 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:57:04 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 709622ce-3956-4747-b274-00bb775d5fcc is timed out.
Nov 02 04:57:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully detached device vdb from instance 709622ce-3956-4747-b274-00bb775d5fcc from the live domain config.
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvKYcrOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7185ff-7e5c-46df-8838-094dfa6abe6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:57:04 user nova-compute[75216]: No targets found.
Nov 02 04:57:04 user nova-compute[75216]: iSNS:
Nov 02 04:57:04 user nova-compute[75216]: No targets found.
Nov 02 04:57:04 user nova-compute[75216]: STATIC:
Nov 02 04:57:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3
Nov 02 04:57:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:57:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:57:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:57:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:57:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:57:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c
Nov 02 04:57:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:57:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:57:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:57:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:57:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:57:04 user nova-compute[75216]: FIRMWARE:
Nov 02 04:57:04 user nova-compute[75216]: No targets found.
Nov 02 04:57:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:57:04 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:57:04 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8596c70-bfc5-4418-88f1-08ce80915d48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae11b036-9324-4391-beff-ac998126051d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:04 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:04 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:57:04 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:04 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:04 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 (non-flash)
Nov 02 04:57:04 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec3afbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec61e83-19ac-450b-8b23-7480c62bc5d5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No VIF found with MAC fa:16:3e:ec:e9:31, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a7810a-1bb4-4857-9739-36671897aa31]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[61749918-8dc3-4908-b508-687f3b04b609]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[165084b0-da37-4389-a3f3-3cdb84db8b8c]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0387c6f-34a8-4c84-8f02-78d39df66bff]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully created port: fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213d587-077e-46a1-98e8-7b8af5e51e8e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260]
Nov 02 04:57:04 user nova-compute[75216]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3, portal: 172.16.0.220,3260] successful.
Nov 02 04:57:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-27822da6-79d8-45f2-b317-ddeb1a7b2f0b tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.803s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed40311-d54e-4204-aa60-e21843e149d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d60ac-0d2e-40a9-97b1-8867aa5a5671]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] <== disconnect_volume: return (344ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:57:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Instance spawned successfully.
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully created port: 18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:57:05 user nova-compute[75216]: INFO nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 02 04:57:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:57:05 user nova-compute[75216]: INFO nova.compute.manager [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Took 7.40 seconds to build instance.
Nov 02 04:57:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-376ac7cd-21bc-431d-b60a-4c38a2fa5503 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.508s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully updated port: 61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-61b6718e-9c4b-462c-af56-b2117e8b8662. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG nova.network.neutron [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port 61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG nova.network.neutron [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG nova.network.neutron [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e708a2d-4ec4-47b3-8c81-dc570ded9b3a req-4944752c-dc0f-4d24-9719-4fa1f288482f service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully updated port: c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully updated port: 393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-c4e822fa-4b56-4530-b90a-7d867c7b8ed8. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-393a501b-cb81-4fe3-83fe-7f2bf2da0be5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port 393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully updated port: a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33620c86-fbca-41e5-98e2-9ce9dca561bf req-de3ed6ee-666d-456c-9717-79177de6e397 service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully updated port: 849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-849bcaec-1bf2-4b87-9b70-7e728cec0154. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port 849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af81845a-1cce-4a08-8987-d2a662a7db8b req-4bb5a40b-992b-43d8-94f9-350be0fef34a service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully updated port: fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-a94ae3f0-817a-4943-ad82-a7efa70d15b6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-106a5ad4-4e98-42f6-95ac-0ee2a85efdf0 req-b4a25719-d2f7-4958-abc8-20b279f7cf81 service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Successfully updated port: 18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-fbb09594-5665-4640-abe0-c1d499c48230. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [{"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance network_info: |[{"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:12 user nova-compute[75216]: DEBUG nova.network.neutron [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updated VIF entry in instance network info cache for port fbb09594-5665-4640-abe0-c1d499c48230. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [{"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-18f60d6e-e06b-4c32-81e9-6a027fb7d909. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port 18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updated VIF entry in instance network info cache for port 18f60d6e-e06b-4c32-81e9-6a027fb7d909. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [{"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f37a7267-0ecb-4f23-8c5a-b1a94c079ff7 req-14399cd6-7988-4e98-ab49-c61a90f6719b service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:57:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7618MB free_disk=24.93240737915039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 5da51a4a-9605-4c02-b3cb-367fafba296f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 709622ce-3956-4747-b274-00bb775d5fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9d70d083-152e-41b7-ac2f-bf525b92593b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 48c33b8f-cdd5-452e-9c39-3e5504db6b1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4da30dfe-3083-4e6c-a3bf-a85eb11d48de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:57:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updating instance_info_cache with network_info: [{"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:57:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:19 user nova-compute[75216]: INFO nova.compute.manager [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Unshelving
Nov 02 04:57:20 user nova-compute[75216]: INFO nova.virt.block_device [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Booting with volume 2d01113d-db63-44c0-95df-346152c151ac at /dev/vda
Nov 02 04:57:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:57:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Creating image(s)
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG os_brick.utils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe6920c-051e-481a-b479-0d1c37c9c99f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30d6985-af20-42fd-a578-59b198e44d27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a72e5d2-e8df-4719-979a-d08d371eefbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3278e1-812e-4a90-a60e-3518e1281577]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:22 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500989e-368c-4991-83a8-233a3a88b999]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG os_brick.utils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating existing volume attachment record: a5a31f01-3a21-453b-aca6-1dea60b52879 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:57:22 user nova-compute[75216]: INFO nova.compute.manager [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Rescuing
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.288s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.250s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk 1073741824" returned: 0 in 0.085s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Updating instance_info_cache with network_info: [{"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Cannot resize image /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Ensure instance console log exists: /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Start _get_guest_xml network_info=[{"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'e940e10f-1cbf-4082-bbaf-5eb3c1efd776', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d70d083-152e-41b7-ac2f-bf525b92593b', 'attached_at': '', 'detached_at': '', 'volume_id': '5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'serial': '5a6f2bf0-953c-4d34-9cbc-c9ef15802626'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:57:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 04:57:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 04:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:23 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310a212-0e4c-4442-a3af-79c4c629716e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:57:23 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a14fec-9a4a-414c-bca3-073fca55c6b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626] added
Nov 02 04:57:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ab8cd-2747-4b3c-b3a7-091aef8bbce4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd7fa6-0865-41d2-92d3-1970c1bb9e42]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwWoeamZ {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-5ea2f655-8253-4852-a648-d409cf8552fa req-d4a17486-2727-49cc-8a8b-3c3440fafb2d service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ea2f655-8253-4852-a648-d409cf8552fa req-d4a17486-2727-49cc-8a8b-3c3440fafb2d service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ea2f655-8253-4852-a648-d409cf8552fa req-d4a17486-2727-49cc-8a8b-3c3440fafb2d service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ea2f655-8253-4852-a648-d409cf8552fa req-d4a17486-2727-49cc-8a8b-3c3440fafb2d service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-5ea2f655-8253-4852-a648-d409cf8552fa req-d4a17486-2727-49cc-8a8b-3c3440fafb2d service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:23 user nova-compute[75216]: WARNING nova.compute.manager [req-5ea2f655-8253-4852-a648-d409cf8552fa req-d4a17486-2727-49cc-8a8b-3c3440fafb2d service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state active and task_state rescuing.
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwWoeamZ" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26617d42-c883-4b76-9f6b-7f323a8e6794]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwWoeamZ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7363d7af-f580-4759-9868-ec4ac575660d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1086f9-5bea-4f99-a50b-479f75cb8941]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:23 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:23 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:23 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:23 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac651fd7-2b5f-4c8a-b23b-a27a3ef5e838]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]
Nov 02 04:57:24 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.
Nov 02 04:57:24 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c5c03-068a-40a4-ade7-54e6c38e8f82]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbae853b-8f45-4a9e-b08f-fc1ba97bf42b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:24 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:24 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:24 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:24 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:24 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:24 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:24 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:24 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915dade-098e-40b9-a25e-92ddcc937e9a]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance destroyed successfully.
Nov 02 04:57:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Attempting a stable device rescue
Nov 02 04:57:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 04:57:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Creating image(s)
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "/opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "/opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "5026b02256976d3d66e279c9a0ab7f4c3250fca6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "5026b02256976d3d66e279c9a0ab7f4c3250fca6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.834s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== connect_volume: return (1837ms) {'type': 'block', 'scsi_wwn': '23733306563643834', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733306563643834', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099158629',display_name='tempest-ServerActionsTestOtherA-server-1648751664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099158629',id=26,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFYOuFoTYzs/OpBaoPrRjbFL2HIlbsNUljvKcH0UTQVvhrHvUp7DogNAcmNfCRZ7AXuFaF52hw+nOmVNTAC/hfKnH2b6bWCetY999y4zJb2XjnFwgLG6UqHmPtnOuruxA==',key_name='tempest-keypair-2120961819',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-2saiixwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=9d70d083-152e-41b7-ac2f-bf525b92593b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:57:25 user nova-compute[75216]:   <uuid>9d70d083-152e-41b7-ac2f-bf525b92593b</uuid>
Nov 02 04:57:25 user nova-compute[75216]:   <name>instance-0000001a</name>
Nov 02 04:57:25 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:57:25 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:57:25 user nova-compute[75216]:   <metadata>
Nov 02 04:57:25 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:57:25 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:57:25 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-1648751664</nova:name>
Nov 02 04:57:25 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:57:23</nova:creationTime>
Nov 02 04:57:25 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:57:25 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:57:25 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:57:25 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:57:25 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:57:25 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:57:25 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:57:25 user nova-compute[75216]:       <nova:owner>
Nov 02 04:57:25 user nova-compute[75216]:         <nova:user uuid="7e3af262ef734b2d8a1b3208e5749fb3">tempest-ServerActionsTestOtherA-511412938-project-member</nova:user>
Nov 02 04:57:25 user nova-compute[75216]:         <nova:project uuid="597c9027651a4044a6514c1ab0ec9ad8">tempest-ServerActionsTestOtherA-511412938</nova:project>
Nov 02 04:57:25 user nova-compute[75216]:       </nova:owner>
Nov 02 04:57:25 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:57:25 user nova-compute[75216]:       <nova:ports>
Nov 02 04:57:25 user nova-compute[75216]:         <nova:port uuid="edd4b05f-28d5-4af0-ba62-5f8112fbc767">
Nov 02 04:57:25 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 04:57:25 user nova-compute[75216]:         </nova:port>
Nov 02 04:57:25 user nova-compute[75216]:       </nova:ports>
Nov 02 04:57:25 user nova-compute[75216]:     </nova:instance>
Nov 02 04:57:25 user nova-compute[75216]:   </metadata>
Nov 02 04:57:25 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:57:25 user nova-compute[75216]:     <system>
Nov 02 04:57:25 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:57:25 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:57:25 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:57:25 user nova-compute[75216]:       <entry name="serial">9d70d083-152e-41b7-ac2f-bf525b92593b</entry>
Nov 02 04:57:25 user nova-compute[75216]:       <entry name="uuid">9d70d083-152e-41b7-ac2f-bf525b92593b</entry>
Nov 02 04:57:25 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:57:25 user nova-compute[75216]:     </system>
Nov 02 04:57:25 user nova-compute[75216]:   </sysinfo>
Nov 02 04:57:25 user nova-compute[75216]:   <os>
Nov 02 04:57:25 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:57:25 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:57:25 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:57:25 user nova-compute[75216]:   </os>
Nov 02 04:57:25 user nova-compute[75216]:   <features>
Nov 02 04:57:25 user nova-compute[75216]:     <acpi/>
Nov 02 04:57:25 user nova-compute[75216]:     <apic/>
Nov 02 04:57:25 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:57:25 user nova-compute[75216]:   </features>
Nov 02 04:57:25 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:57:25 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:57:25 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:57:25 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:57:25 user nova-compute[75216]:   </clock>
Nov 02 04:57:25 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:57:25 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:57:25 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:57:25 user nova-compute[75216]:   </cpu>
Nov 02 04:57:25 user nova-compute[75216]:   <devices>
Nov 02 04:57:25 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:57:25 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:57:25 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk"/>
Nov 02 04:57:25 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:57:25 user nova-compute[75216]:     </disk>
Nov 02 04:57:25 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:57:25 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:57:25 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 04:57:25 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 04:57:25 user nova-compute[75216]:       <serial>5a6f2bf0-953c-4d34-9cbc-c9ef15802626</serial>
Nov 02 04:57:25 user nova-compute[75216]:     </disk>
Nov 02 04:57:25 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:57:25 user nova-compute[75216]:       <mac address="fa:16:3e:aa:fa:51"/>
Nov 02 04:57:25 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:25 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:57:25 user nova-compute[75216]:       <target dev="tapedd4b05f-28"/>
Nov 02 04:57:25 user nova-compute[75216]:     </interface>
Nov 02 04:57:25 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:57:25 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/console.log" append="off"/>
Nov 02 04:57:25 user nova-compute[75216]:     </serial>
Nov 02 04:57:25 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:57:25 user nova-compute[75216]:     <video>
Nov 02 04:57:25 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:25 user nova-compute[75216]:     </video>
Nov 02 04:57:25 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:57:25 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:57:25 user nova-compute[75216]:     </rng>
Nov 02 04:57:25 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:57:25 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:57:25 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:57:25 user nova-compute[75216]:     </memballoon>
Nov 02 04:57:25 user nova-compute[75216]:   </devices>
Nov 02 04:57:25 user nova-compute[75216]: </domain>
Nov 02 04:57:25 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099158629',display_name='tempest-ServerActionsTestOtherA-server-1648751664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099158629',id=26,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFYOuFoTYzs/OpBaoPrRjbFL2HIlbsNUljvKcH0UTQVvhrHvUp7DogNAcmNfCRZ7AXuFaF52hw+nOmVNTAC/hfKnH2b6bWCetY999y4zJb2XjnFwgLG6UqHmPtnOuruxA==',key_name='tempest-keypair-2120961819',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-2saiixwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=9d70d083-152e-41b7-ac2f-bf525b92593b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG os_vif [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82fd0a3a-9aa3-5dd3-8e62-9830699f2a1a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd4b05f-28, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedd4b05f-28, col_values=(('qos', UUID('a0afad53-7bdf-4c57-9b5b-fc0af4a645c4')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedd4b05f-28, col_values=(('external_ids', {'iface-id': 'edd4b05f-28d5-4af0-ba62-5f8112fbc767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:fa:51', 'vm-uuid': '9d70d083-152e-41b7-ac2f-bf525b92593b'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:25 user nova-compute[75216]: INFO os_vif [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28')
Nov 02 04:57:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.images [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] 36502484-cd04-4124-8e83-12d8f990dcdc was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.part /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No VIF found with MAC fa:16:3e:aa:fa:51, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b4f232da-9443-4a2c-a690-e85342adc7a4 req-4ef8c2ed-e4bc-4db0-81f2-9fbf7a900c16 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4f232da-9443-4a2c-a690-e85342adc7a4 req-4ef8c2ed-e4bc-4db0-81f2-9fbf7a900c16 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4f232da-9443-4a2c-a690-e85342adc7a4 req-4ef8c2ed-e4bc-4db0-81f2-9fbf7a900c16 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b4f232da-9443-4a2c-a690-e85342adc7a4 req-4ef8c2ed-e4bc-4db0-81f2-9fbf7a900c16 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-b4f232da-9443-4a2c-a690-e85342adc7a4 req-4ef8c2ed-e4bc-4db0-81f2-9fbf7a900c16 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:26 user nova-compute[75216]: WARNING nova.compute.manager [req-b4f232da-9443-4a2c-a690-e85342adc7a4 req-4ef8c2ed-e4bc-4db0-81f2-9fbf7a900c16 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state active and task_state rescuing.
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.part /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.converted" returned: 0 in 0.398s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "5026b02256976d3d66e279c9a0ab7f4c3250fca6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.898s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "5026b02256976d3d66e279c9a0ab7f4c3250fca6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "5026b02256976d3d66e279c9a0ab7f4c3250fca6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6,backing_fmt=raw /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6,backing_fmt=raw /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.rescue" returned: 0 in 0.059s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "5026b02256976d3d66e279c9a0ab7f4c3250fca6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'migration_context' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<48c33b8f-cdd5-452e-9c39-3e5504db6b1f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Start _get_guest_xml network_info=[{"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "vif_mac": "fa:16:3e:1c:3a:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36502484-cd04-4124-8e83-12d8f990dcdc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '28e2aa13-43a3-44ef-91fd-8ccbf2fdf628', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUGKjhEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '48c33b8f-cdd5-452e-9c39-3e5504db6b1f', 'attached_at': '', 'detached_at': '', 'volume_id': '6fb11303-8f48-490e-86f7-f904a2fe33b4', 'serial': '6fb11303-8f48-490e-86f7-f904a2fe33b4'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'resources' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<48c33b8f-cdd5-452e-9c39-3e5504db6b1f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'numa_topology' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<48c33b8f-cdd5-452e-9c39-3e5504db6b1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:57:26 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:26 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.objects.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<48c33b8f-cdd5-452e-9c39-3e5504db6b1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUGKjhEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:26 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[85047973-56cb-46a1-ab8b-aed42eeebc0d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZUGKjhEg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 04:57:26 user nova-compute[75216]: node.name = iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:57:26 user nova-compute[75216]: node.tpgt = -1
Nov 02 04:57:26 user nova-compute[75216]: node.startup = automatic
Nov 02 04:57:26 user nova-compute[75216]: node.leading_login = No
Nov 02 04:57:26 user nova-compute[75216]: iface.iscsi_ifacename = default
Nov 02 04:57:26 user nova-compute[75216]: iface.net_ifacename = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.ipaddress = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.prefix_len = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.hwaddress = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.transport_name = tcp
Nov 02 04:57:26 user nova-compute[75216]: iface.initiatorname = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.state = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.vlan_id = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.vlan_priority = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.vlan_state = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.iface_num = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.mtu = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.port = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.bootproto = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.subnet_mask = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.gateway = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_alt_client_id = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_dns = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_learn_iqn = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_vendor_id_state = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_vendor_id = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.dhcp_slp_da = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.fragmentation = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.gratuitous_arp = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.incoming_forwarding = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.tos_state = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.tos = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.ttl = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.delayed_ack = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.tcp_nagle = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.tcp_wsf_state = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.tcp_wsf = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.tcp_timer_scale = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.tcp_timestamp = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.redirect = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.def_task_mgmt_timeout = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.header_digest = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.data_digest = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.immediate_data = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.initial_r2t = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.data_seq_inorder = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.data_pdu_inorder = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.erl = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.max_receive_data_len = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.first_burst_len = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.max_outstanding_r2t = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.max_burst_len = 0
Nov 02 04:57:26 user nova-compute[75216]: iface.chap_auth = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.bidi_chap = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.strict_login_compliance = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.discovery_auth = <empty>
Nov 02 04:57:26 user nova-compute[75216]: iface.discovery_logout = <empty>
Nov 02 04:57:26 user nova-compute[75216]: node.discovery_address = <empty>
Nov 02 04:57:26 user nova-compute[75216]: node.discovery_port = 0
Nov 02 04:57:26 user nova-compute[75216]: node.discovery_type = static
Nov 02 04:57:26 user nova-compute[75216]: node.session.initial_cmdsn = 0
Nov 02 04:57:26 user nova-compute[75216]: node.session.initial_login_retry_max = 8
Nov 02 04:57:26 user nova-compute[75216]: node.session.xmit_thread_priority = -20
Nov 02 04:57:26 user nova-compute[75216]: node.session.cmds_max = 128
Nov 02 04:57:26 user nova-compute[75216]: node.session.queue_depth = 32
Nov 02 04:57:26 user nova-compute[75216]: node.session.nr_sessions = 1
Nov 02 04:57:26 user nova-compute[75216]: node.session.auth.authmethod = CHAP
Nov 02 04:57:26 user nova-compute[75216]: node.session.auth.username = ZUGKjhEg
Nov 02 04:57:26 user nova-compute[75216]: node.session.auth.password = ***
Nov 02 04:57:26 user nova-compute[75216]: node.session.auth.username_in = <empty>
Nov 02 04:57:26 user nova-compute[75216]: node.session.auth.password_in = <empty>
Nov 02 04:57:26 user nova-compute[75216]: node.session.auth.chap_algs = MD5
Nov 02 04:57:26 user nova-compute[75216]: node.session.timeo.replacement_timeout = 120
Nov 02 04:57:26 user nova-compute[75216]: node.session.err_timeo.abort_timeout = 15
Nov 02 04:57:26 user nova-compute[75216]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 04:57:26 user nova-compute[75216]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 04:57:26 user nova-compute[75216]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.FastAbort = Yes
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.InitialR2T = No
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.ImmediateData = Yes
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.MaxConnections = 1
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 04:57:26 user nova-compute[75216]: node.session.iscsi.ERL = 0
Nov 02 04:57:26 user nova-compute[75216]: node.session.scan = manual
Nov 02 04:57:26 user nova-compute[75216]: node.session.reopen_max = 0
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].address = 172.16.0.220
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].port = 3260
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].startup = manual
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].tcp.window_size = 524288
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].tcp.type_of_service = 0
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].timeo.logout_timeout = 15
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].timeo.login_timeout = 15
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].timeo.auth_timeout = 45
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].iscsi.DataDigest = None
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].iscsi.IFMarker = No
Nov 02 04:57:26 user nova-compute[75216]: node.conn[0].iscsi.OFMarker = No
Nov 02 04:57:26 user nova-compute[75216]: # END RECORD
Nov 02 04:57:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8cf1e7-74cf-4140-a27b-369781273834]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b61c2-9b86-4098-92b7-3d2426af0b5e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUGKjhEg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUGKjhEg" returned: 0 in 0.037s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd98caba-bcdc-4455-b13d-f8d28b82b01b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZUGKjhEg'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89c3919-a200-486c-9869-e746fddb36e5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2759ad-4ccb-4c7d-8640-249473e9af76]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:26 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:26 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:26 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:26 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:26 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:26 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] HCTL ('35', '0', '0', 0) found on session 24 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da1f9ba-2a6a-4027-99c7-f8f8d8a9b38a]: (4, ('0 0 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Searching for a device in session 24 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUGKjhEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== connect_volume: return (205ms) {'type': 'block', 'scsi_wwn': '23437623533346464', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437623533346464', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413566755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413566755',id=27,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-k1ojyas8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:55:33Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=48c33b8f-cdd5-452e-9c39-3e5504db6b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "vif_mac": "fa:16:3e:1c:3a:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "vif_mac": "fa:16:3e:1c:3a:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'pci_devices' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.objects.base [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Object Instance<48c33b8f-cdd5-452e-9c39-3e5504db6b1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:57:27 user nova-compute[75216]:   <uuid>48c33b8f-cdd5-452e-9c39-3e5504db6b1f</uuid>
Nov 02 04:57:27 user nova-compute[75216]:   <name>instance-0000001b</name>
Nov 02 04:57:27 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:57:27 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:57:27 user nova-compute[75216]:   <metadata>
Nov 02 04:57:27 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:57:27 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:57:27 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-413566755</nova:name>
Nov 02 04:57:27 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:57:26</nova:creationTime>
Nov 02 04:57:27 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:57:27 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:57:27 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:57:27 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:57:27 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:57:27 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:57:27 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:57:27 user nova-compute[75216]:       <nova:owner>
Nov 02 04:57:27 user nova-compute[75216]:         <nova:user uuid="ae71d7b88da2452a9ec4489a0ef49176">tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member</nova:user>
Nov 02 04:57:27 user nova-compute[75216]:         <nova:project uuid="f6771c51304d446b8338d0d879ede48f">tempest-ServerBootFromVolumeStableRescueTest-1501080447</nova:project>
Nov 02 04:57:27 user nova-compute[75216]:       </nova:owner>
Nov 02 04:57:27 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:57:27 user nova-compute[75216]:       <nova:ports>
Nov 02 04:57:27 user nova-compute[75216]:         <nova:port uuid="464a9293-b58e-4233-9747-71ecf5994bd9">
Nov 02 04:57:27 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 04:57:27 user nova-compute[75216]:         </nova:port>
Nov 02 04:57:27 user nova-compute[75216]:       </nova:ports>
Nov 02 04:57:27 user nova-compute[75216]:     </nova:instance>
Nov 02 04:57:27 user nova-compute[75216]:   </metadata>
Nov 02 04:57:27 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:57:27 user nova-compute[75216]:     <system>
Nov 02 04:57:27 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:57:27 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:57:27 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:57:27 user nova-compute[75216]:       <entry name="serial">48c33b8f-cdd5-452e-9c39-3e5504db6b1f</entry>
Nov 02 04:57:27 user nova-compute[75216]:       <entry name="uuid">48c33b8f-cdd5-452e-9c39-3e5504db6b1f</entry>
Nov 02 04:57:27 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:57:27 user nova-compute[75216]:     </system>
Nov 02 04:57:27 user nova-compute[75216]:   </sysinfo>
Nov 02 04:57:27 user nova-compute[75216]:   <os>
Nov 02 04:57:27 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:57:27 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:57:27 user nova-compute[75216]:   </os>
Nov 02 04:57:27 user nova-compute[75216]:   <features>
Nov 02 04:57:27 user nova-compute[75216]:     <acpi/>
Nov 02 04:57:27 user nova-compute[75216]:     <apic/>
Nov 02 04:57:27 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:57:27 user nova-compute[75216]:   </features>
Nov 02 04:57:27 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:57:27 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:57:27 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:57:27 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:57:27 user nova-compute[75216]:   </clock>
Nov 02 04:57:27 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:57:27 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:57:27 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:57:27 user nova-compute[75216]:   </cpu>
Nov 02 04:57:27 user nova-compute[75216]:   <devices>
Nov 02 04:57:27 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:57:27 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:57:27 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 02 04:57:27 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:57:27 user nova-compute[75216]:       <serial>6fb11303-8f48-490e-86f7-f904a2fe33b4</serial>
Nov 02 04:57:27 user nova-compute[75216]:     </disk>
Nov 02 04:57:27 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:57:27 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:57:27 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.rescue"/>
Nov 02 04:57:27 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 04:57:27 user nova-compute[75216]:       <boot order="1"/>
Nov 02 04:57:27 user nova-compute[75216]:     </disk>
Nov 02 04:57:27 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:57:27 user nova-compute[75216]:       <mac address="fa:16:3e:1c:3a:87"/>
Nov 02 04:57:27 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:27 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:57:27 user nova-compute[75216]:       <target dev="tap464a9293-b5"/>
Nov 02 04:57:27 user nova-compute[75216]:     </interface>
Nov 02 04:57:27 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:57:27 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/console.log" append="off"/>
Nov 02 04:57:27 user nova-compute[75216]:     </serial>
Nov 02 04:57:27 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:57:27 user nova-compute[75216]:     <video>
Nov 02 04:57:27 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:27 user nova-compute[75216]:     </video>
Nov 02 04:57:27 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:57:27 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:57:27 user nova-compute[75216]:     </rng>
Nov 02 04:57:27 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:57:27 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:57:27 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:57:27 user nova-compute[75216]:     </memballoon>
Nov 02 04:57:27 user nova-compute[75216]:   </devices>
Nov 02 04:57:27 user nova-compute[75216]: </domain>
Nov 02 04:57:27 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:57:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance destroyed successfully.
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] No VIF found with MAC fa:16:3e:1c:3a:87, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'flavor' on Instance uuid 709622ce-3956-4747-b274-00bb775d5fcc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5bde16cf-ebb0-4c5e-b985-c32e58bfefbb tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 43.465s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:28 user nova-compute[75216]: INFO nova.virt.block_device [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Booting with volume f9653497-568d-4be0-b250-516eac053abf at /dev/vdb
Nov 02 04:57:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:28 user nova-compute[75216]: WARNING nova.compute.manager [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received unexpected event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 04:57:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:28 user nova-compute[75216]: WARNING nova.compute.manager [req-dfc83463-0a6e-4e87-9e40-eb9fa3a5dad0 req-2ea81c86-7783-4b2e-8ae8-eafb8f7f3ff4 service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received unexpected event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 04:57:28 user nova-compute[75216]: DEBUG os_brick.utils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[224f25c7-847d-4541-bff9-392b41695731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d097ea6-9753-4a4d-9b1c-9dfaf96eb35e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43989e4-4b68-4da2-89bf-a1733fc69520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6437c994-c6c5-4a63-a975-c89e8f019ba5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:28 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:57:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3bfec3-d9f3-4458-aa31-97d1d23ab3db]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG os_brick.utils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:28 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating existing volume attachment record: 2703cd55-45dc-465d-a327-e365fea4f51f {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:29 user nova-compute[75216]: INFO nova.compute.manager [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Attaching volume 5a1028ef-cd2a-4842-9c0c-16df9275dae0 to /dev/vdc
Nov 02 04:57:30 user nova-compute[75216]: DEBUG os_brick.utils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[417cb792-5857-40cc-ac3a-592dcc2fe3eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00be1a3-2beb-41ee-9484-2345e79ba404]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:30 user nova-compute[75216]: WARNING nova.compute.manager [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state active and task_state rescuing.
Nov 02 04:57:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:30 user nova-compute[75216]: WARNING nova.compute.manager [req-1999b31c-a1e9-4639-b25e-fa5362cb1808 req-67001679-09ce-40f4-ad6c-9e0aeb79f024 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state active and task_state rescuing.
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5401e13-a00b-4f8b-bba6-fe606c01ff0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fd5964-f3dc-47c0-9559-7429274bbc41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:57:30 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:57:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70afb5b9-9615-4132-82da-9f10050d0799]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG os_brick.utils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updating existing volume attachment record: a986d0db-d916-4e99-b18a-c8130a72b82b {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:57:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance spawned successfully.
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75216) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a866e434-8283-47ef-9425-3dfdc2298b99 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-41499be1-5029-41dd-9361-b9378a0f3688 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:57:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'pci_requests' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'numa_topology' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:57:45 user nova-compute[75216]: INFO nova.compute.claims [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Claim successful on node user
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:45 user nova-compute[75216]: INFO nova.compute.manager [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Terminating instance
Nov 02 04:57:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b5b5cfe-5c07-449d-badc-b66c7027b6e0 req-2c7d8188-12dd-4e19-b487-e80537e37f7b service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-vif-unplugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b5b5cfe-5c07-449d-badc-b66c7027b6e0 req-2c7d8188-12dd-4e19-b487-e80537e37f7b service nova] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b5b5cfe-5c07-449d-badc-b66c7027b6e0 req-2c7d8188-12dd-4e19-b487-e80537e37f7b service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b5b5cfe-5c07-449d-badc-b66c7027b6e0 req-2c7d8188-12dd-4e19-b487-e80537e37f7b service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b5b5cfe-5c07-449d-badc-b66c7027b6e0 req-2c7d8188-12dd-4e19-b487-e80537e37f7b service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] No waiting events found dispatching network-vif-unplugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b5b5cfe-5c07-449d-badc-b66c7027b6e0 req-2c7d8188-12dd-4e19-b487-e80537e37f7b service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-vif-unplugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.923s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:46 user nova-compute[75216]: INFO nova.network.neutron [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating port a399f62c-e5e9-46bd-afae-7261a28b46b3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Instance destroyed successfully.
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lazy-loading 'resources' on Instance uuid 709622ce-3956-4747-b274-00bb775d5fcc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-597868679',display_name='tempest-AttachVolumeNegativeTest-server-597868679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-597868679',id=25,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRXCiq2yOIRdQxyJndrPOL+c/KxpbQEd3TCSp+GYgutIx9e3QQLa0mCGjYV/bi++5nJPVgD/XuCm5e0wmcuGp3amay7mZFsuINz+8xw6Sw2VKUT0zeTOfLfkokPjXOIw==',key_name='tempest-keypair-664360866',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1c01690c91146afa3833bea67f8157f',ramdisk_id='',reservation_id='r-4gtlmfur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1766043636',owner_user_name='tempest-AttachVolumeNegativeTest-1766043636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43528060361f4924b8a858bdd2e731cc',uuid=709622ce-3956-4747-b274-00bb775d5fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converting VIF {"id": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "address": "fa:16:3e:fd:65:76", "network": {"id": "9f078d76-4345-471e-9ebc-c45a53d9b23a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1703209461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1c01690c91146afa3833bea67f8157f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc90b667f-96", "ovs_interfaceid": "c90b667f-9641-4074-b8b8-2cbdcd7abee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:65:76,bridge_name='br-int',has_traffic_filtering=True,id=c90b667f-9641-4074-b8b8-2cbdcd7abee3,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90b667f-96') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG os_vif [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:65:76,bridge_name='br-int',has_traffic_filtering=True,id=c90b667f-9641-4074-b8b8-2cbdcd7abee3,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90b667f-96') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc90b667f-96, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f757ff4-d1be-4745-bcf1-d945c0c6eb3e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: INFO os_vif [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:65:76,bridge_name='br-int',has_traffic_filtering=True,id=c90b667f-9641-4074-b8b8-2cbdcd7abee3,network=Network(9f078d76-4345-471e-9ebc-c45a53d9b23a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc90b667f-96')
Nov 02 04:57:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Deleting instance files /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc_del
Nov 02 04:57:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Deletion of /opt/stack/data/nova/instances/709622ce-3956-4747-b274-00bb775d5fcc_del complete
Nov 02 04:57:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:46 user nova-compute[75216]: INFO nova.compute.manager [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 02 04:57:46 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:57:46 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:47 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Took 0.96 seconds to deallocate network for instance.
Nov 02 04:57:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1bc9ff62-23a6-4195-af46-e153ad716037 req-4938bb8c-d85f-4dde-a896-bc92e7f7db60 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-vif-deleted-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] No waiting events found dispatching network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:48 user nova-compute[75216]: WARNING nova.compute.manager [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received unexpected event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 for instance with vm_state deleted and task_state None.
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] Acquiring lock "709622ce-3956-4747-b274-00bb775d5fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] Lock "709622ce-3956-4747-b274-00bb775d5fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] No waiting events found dispatching network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:48 user nova-compute[75216]: WARNING nova.compute.manager [req-abd737fa-ae0f-4d87-8c34-ce4882cb6e2f req-c72359df-a093-4c4d-862e-b5152e16e481 service nova] [instance: 709622ce-3956-4747-b274-00bb775d5fcc] Received unexpected event network-vif-plugged-c90b667f-9641-4074-b8b8-2cbdcd7abee3 for instance with vm_state deleted and task_state None.
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:48 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Deleted allocations for instance 709622ce-3956-4747-b274-00bb775d5fcc
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0b96f13c-b73c-47d2-9d7d-cbf6eb4432df tempest-AttachVolumeNegativeTest-1766043636 tempest-AttachVolumeNegativeTest-1766043636-project-member] Lock "709622ce-3956-4747-b274-00bb775d5fcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.971s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:57:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Creating image(s)
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Ensure instance console log exists: /opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Start _get_guest_xml network_info=[{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a5a31f01-3a21-453b-aca6-1dea60b52879', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf29e71d-bdea-49a2-9640-5fb7bc9ff72f', 'attached_at': '', 'detached_at': '', 'volume_id': '2d01113d-db63-44c0-95df-346152c151ac', 'serial': '2d01113d-db63-44c0-95df-346152c151ac'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:57:48 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:48 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.objects.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Object Instance<bf29e71d-bdea-49a2-9640-5fb7bc9ff72f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:48 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2475ab1d-6b48-4d34-90a1-4931a3667adf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:57:48 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c94a3-20d5-49b9-b22c-e940b9395703]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac] added
Nov 02 04:57:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eaf200-03e9-49e8-a561-83fe355abaf5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0c242c-5df6-435f-a700-e4d43d86364c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPWkMNDu {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPWkMNDu" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dcdc5c-becf-4ad2-812a-9d937983c4cc]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oPWkMNDu'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ea49f0-d297-40da-90ce-c21ef7549b16]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd3b087-4969-4482-99ec-55c4d215ee7b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da90de-e5ad-48da-b78c-e875054884b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]
Nov 02 04:57:48 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.
Nov 02 04:57:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb9c1d5-9eb4-48cf-9389-9deab350ce16]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d01e36c-25b9-469c-b787-d9b49f8f59f0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:57:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:48 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:57:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba45f4-37b1-4876-ab62-901f235e4ffe]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:57:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23532386435313535', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532386435313535', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1658344299',display_name='tempest-TestShelveInstance-server-1658344299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1658344299',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1286148874',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0f36dd21f3ea4792a9b68ed89eb31a58',ramdisk_id='',reservation_id='r-zkw0auwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1358632032',owner_user_name='tempest-TestShelveInstance-1358632032-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:57:20Z,user_data=None,user_id='e2cc45316cf74e649bdf7d88cf460c6e',uuid=bf29e71d-bdea-49a2-9640-5fb7bc9ff72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converting VIF {"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'pci_devices' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.objects.base [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Object Instance<bf29e71d-bdea-49a2-9640-5fb7bc9ff72f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:57:50 user nova-compute[75216]:   <uuid>bf29e71d-bdea-49a2-9640-5fb7bc9ff72f</uuid>
Nov 02 04:57:50 user nova-compute[75216]:   <name>instance-00000017</name>
Nov 02 04:57:50 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:57:50 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:57:50 user nova-compute[75216]:   <metadata>
Nov 02 04:57:50 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:57:50 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:57:50 user nova-compute[75216]:       <nova:name>tempest-TestShelveInstance-server-1658344299</nova:name>
Nov 02 04:57:50 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:57:48</nova:creationTime>
Nov 02 04:57:50 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:57:50 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:57:50 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:57:50 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:57:50 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:57:50 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:57:50 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:57:50 user nova-compute[75216]:       <nova:owner>
Nov 02 04:57:50 user nova-compute[75216]:         <nova:user uuid="e2cc45316cf74e649bdf7d88cf460c6e">tempest-TestShelveInstance-1358632032-project-member</nova:user>
Nov 02 04:57:50 user nova-compute[75216]:         <nova:project uuid="0f36dd21f3ea4792a9b68ed89eb31a58">tempest-TestShelveInstance-1358632032</nova:project>
Nov 02 04:57:50 user nova-compute[75216]:       </nova:owner>
Nov 02 04:57:50 user nova-compute[75216]:       <nova:ports>
Nov 02 04:57:50 user nova-compute[75216]:         <nova:port uuid="a399f62c-e5e9-46bd-afae-7261a28b46b3">
Nov 02 04:57:50 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 04:57:50 user nova-compute[75216]:         </nova:port>
Nov 02 04:57:50 user nova-compute[75216]:       </nova:ports>
Nov 02 04:57:50 user nova-compute[75216]:     </nova:instance>
Nov 02 04:57:50 user nova-compute[75216]:   </metadata>
Nov 02 04:57:50 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:57:50 user nova-compute[75216]:     <system>
Nov 02 04:57:50 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:57:50 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:57:50 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:57:50 user nova-compute[75216]:       <entry name="serial">bf29e71d-bdea-49a2-9640-5fb7bc9ff72f</entry>
Nov 02 04:57:50 user nova-compute[75216]:       <entry name="uuid">bf29e71d-bdea-49a2-9640-5fb7bc9ff72f</entry>
Nov 02 04:57:50 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:57:50 user nova-compute[75216]:     </system>
Nov 02 04:57:50 user nova-compute[75216]:   </sysinfo>
Nov 02 04:57:50 user nova-compute[75216]:   <os>
Nov 02 04:57:50 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:57:50 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:57:50 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:57:50 user nova-compute[75216]:   </os>
Nov 02 04:57:50 user nova-compute[75216]:   <features>
Nov 02 04:57:50 user nova-compute[75216]:     <acpi/>
Nov 02 04:57:50 user nova-compute[75216]:     <apic/>
Nov 02 04:57:50 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:57:50 user nova-compute[75216]:   </features>
Nov 02 04:57:50 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:57:50 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:57:50 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:57:50 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:57:50 user nova-compute[75216]:   </clock>
Nov 02 04:57:50 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:57:50 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:57:50 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:57:50 user nova-compute[75216]:   </cpu>
Nov 02 04:57:50 user nova-compute[75216]:   <devices>
Nov 02 04:57:50 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:57:50 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:57:50 user nova-compute[75216]:       <source dev="/dev/sde"/>
Nov 02 04:57:50 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:57:50 user nova-compute[75216]:       <serial>2d01113d-db63-44c0-95df-346152c151ac</serial>
Nov 02 04:57:50 user nova-compute[75216]:     </disk>
Nov 02 04:57:50 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:57:50 user nova-compute[75216]:       <mac address="fa:16:3e:fb:34:c5"/>
Nov 02 04:57:50 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:50 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:57:50 user nova-compute[75216]:       <target dev="tapa399f62c-e5"/>
Nov 02 04:57:50 user nova-compute[75216]:     </interface>
Nov 02 04:57:50 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:57:50 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f/console.log" append="off"/>
Nov 02 04:57:50 user nova-compute[75216]:     </serial>
Nov 02 04:57:50 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:57:50 user nova-compute[75216]:     <video>
Nov 02 04:57:50 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:57:50 user nova-compute[75216]:     </video>
Nov 02 04:57:50 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:57:50 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:57:50 user nova-compute[75216]:     </rng>
Nov 02 04:57:50 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:57:50 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:57:50 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:57:50 user nova-compute[75216]:     </memballoon>
Nov 02 04:57:50 user nova-compute[75216]:   </devices>
Nov 02 04:57:50 user nova-compute[75216]: </domain>
Nov 02 04:57:50 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1658344299',display_name='tempest-TestShelveInstance-server-1658344299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1658344299',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1286148874',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0f36dd21f3ea4792a9b68ed89eb31a58',ramdisk_id='',reservation_id='r-zkw0auwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1358632032',owner_user_name='tempest-TestShelveInstance-1358632032-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:57:20Z,user_data=None,user_id='e2cc45316cf74e649bdf7d88cf460c6e',uuid=bf29e71d-bdea-49a2-9640-5fb7bc9ff72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converting VIF {"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG os_vif [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f547ee26-f69d-5dae-9a81-dc5382932a54', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa399f62c-e5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa399f62c-e5, col_values=(('qos', UUID('5b940873-6999-46bf-a2f6-6e48e049d8ad')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa399f62c-e5, col_values=(('external_ids', {'iface-id': 'a399f62c-e5e9-46bd-afae-7261a28b46b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:34:c5', 'vm-uuid': 'bf29e71d-bdea-49a2-9640-5fb7bc9ff72f'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:50 user nova-compute[75216]: INFO os_vif [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5')
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing instance network info cache due to event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] No VIF found with MAC fa:16:3e:fb:34:c5, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updated VIF entry in instance network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5acf681c-395d-4342-b412-32ff59199c17 req-3db8cf90-c4cb-4d7e-8d72-e8bd0ccd012e service nova] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-958410e6-6195-486e-9a29-e3674882773e req-7e1519f5-1070-4012-b895-ed253debc4ea service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-958410e6-6195-486e-9a29-e3674882773e req-7e1519f5-1070-4012-b895-ed253debc4ea service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-958410e6-6195-486e-9a29-e3674882773e req-7e1519f5-1070-4012-b895-ed253debc4ea service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-958410e6-6195-486e-9a29-e3674882773e req-7e1519f5-1070-4012-b895-ed253debc4ea service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-958410e6-6195-486e-9a29-e3674882773e req-7e1519f5-1070-4012-b895-ed253debc4ea service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:51 user nova-compute[75216]: WARNING nova.compute.manager [req-958410e6-6195-486e-9a29-e3674882773e req-7e1519f5-1070-4012-b895-ed253debc4ea service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 04:57:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyPEUgMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:57:52 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:52 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:57:52 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af5ffcd-1393-4b3a-8d9d-96d8cfd423e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:57:52 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d80256e-b6ab-4ea9-a879-591b699a11f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0] added
Nov 02 04:57:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfa5422-17c5-4e13-94ff-ecdc174d75aa]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b3fbb-8ba4-4095-ba0b-8ef6e0cddbc8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyPEUgMv {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyPEUgMv" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95bfbc-60d4-4b21-960d-dd7f2301931c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cyPEUgMv'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98893d57-278e-45ac-ba48-3774757b99b4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[654f527d-c11c-429f-bdf9-e12ba5cae2dc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:57:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:57:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6374ef-9225-42bd-8504-d277b59b661a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260]
Nov 02 04:57:53 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260] successful.
Nov 02 04:57:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4430c6-ccd1-4cbc-93bd-0761b1368718]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764eb2d-9120-48fa-be8d-abf039a0782f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:57:53 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:57:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[639fd39e-d87e-4154-b6a6-fbf3040e7c33]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyPEUgMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d018748-d894-4d28-a6d3-9aa6515f89bc req-ed972bb4-380f-4c94-9b09-9f4811279f80 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d018748-d894-4d28-a6d3-9aa6515f89bc req-ed972bb4-380f-4c94-9b09-9f4811279f80 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d018748-d894-4d28-a6d3-9aa6515f89bc req-ed972bb4-380f-4c94-9b09-9f4811279f80 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d018748-d894-4d28-a6d3-9aa6515f89bc req-ed972bb4-380f-4c94-9b09-9f4811279f80 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d018748-d894-4d28-a6d3-9aa6515f89bc req-ed972bb4-380f-4c94-9b09-9f4811279f80 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:57:53 user nova-compute[75216]: WARNING nova.compute.manager [req-3d018748-d894-4d28-a6d3-9aa6515f89bc req-ed972bb4-380f-4c94-9b09-9f4811279f80 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 04:57:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:57:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance spawned successfully.
Nov 02 04:57:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95fbfc3f-0a0e-4bb3-9a16-48e6d1e60d4b tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.876s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23631333262613565', 'path': '/dev/sdg'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631333262613565', 'path': '/dev/sdg'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:57:54 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:57:54 user nova-compute[75216]:   <source dev="/dev/sdg"/>
Nov 02 04:57:54 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 04:57:54 user nova-compute[75216]:   <serial>5a1028ef-cd2a-4842-9c0c-16df9275dae0</serial>
Nov 02 04:57:54 user nova-compute[75216]: </disk>
Nov 02 04:57:54 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] No VIF found with MAC fa:16:3e:ec:e9:31, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0d72b485-61ee-4063-a17e-365675ec24b2 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.916s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:57:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:57:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:56 user nova-compute[75216]: INFO nova.compute.manager [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Detaching volume 4c275706-92e9-49cb-b68c-5305d1572b3c
Nov 02 04:57:56 user nova-compute[75216]: INFO nova.virt.block_device [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Attempting to driver detach volume 4c275706-92e9-49cb-b68c-5305d1572b3c from mountpoint /dev/vdb
Nov 02 04:57:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Attempting to detach device vdb from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:57:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:57:56 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:57:56 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:57:56 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:57:56 user nova-compute[75216]:   <serial>4c275706-92e9-49cb-b68c-5305d1572b3c</serial>
Nov 02 04:57:56 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:57:56 user nova-compute[75216]: </disk>
Nov 02 04:57:56 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:57:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully detached device vdb from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the persistent domain config.
Nov 02 04:57:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:57:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:57:56 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:57:56 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 04:57:56 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:57:56 user nova-compute[75216]:   <serial>4c275706-92e9-49cb-b68c-5305d1572b3c</serial>
Nov 02 04:57:56 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:57:56 user nova-compute[75216]: </disk>
Nov 02 04:57:56 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:57:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:57:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 04:57:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:57:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:57:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 04:57:59 user nova-compute[75216]: INFO nova.compute.claims [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Claim successful on node user
Nov 02 04:58:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 04:58:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.policy [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c01f25553f947d781c9c8b8a0953203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b49d78b7cd47db8284e82230b2237f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:58:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Creating image(s)
Nov 02 04:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "/opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "/opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "/opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.216s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk 1073741824" returned: 0 in 0.066s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Successfully created port: a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.281s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Cannot resize image /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Ensure instance console log exists: /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:01 user nova-compute[75216]: INFO nova.virt.block_device [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Booting with volume 93672707-7936-4c52-9f52-4eef05b3e8ce at /dev/vdc
Nov 02 04:58:01 user nova-compute[75216]: DEBUG os_brick.utils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b04fb0c-55c1-45f5-b13a-3a872bf20fc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42123053-ac51-48f1-a8c9-9c5faf2d7cf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3e8224-9b75-4082-8194-0da468237fe9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d069de68-db8e-4c62-af25-a277d28bd821]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:58:02 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef919df-091d-41a2-b3cd-4085b27a47f3]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG os_brick.utils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating existing volume attachment record: af0d9f86-eea7-4bcc-8703-d7cedf7882c3 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Successfully updated port: a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquired lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-changed-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Refreshing instance network info cache due to event network-changed-a7ccfecd-5875-4e4f-9780-15250fd24876. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] Acquiring lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Updating instance_info_cache with network_info: [{"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Releasing lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Instance network_info: |[{"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] Acquired lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Refreshing network info cache for port a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Start _get_guest_xml network_info=[{"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:58:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:58:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1866729633',display_name='tempest-VolumesSnapshotTestJSON-instance-1866729633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1866729633',id=31,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0CghsnCRqCQ5dJUL2f470G7WiwFcEtwKLwbx8rDrhugToShkpBJRNcWmNYuAHT9SEFG2+VB3jL2o1ptXgXJc2Qf0h7rSF5qANVJbT71zCSNf69QzHSEh5/T4wUA2vo1w==',key_name='tempest-keypair-1925365009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65b49d78b7cd47db8284e82230b2237f',ramdisk_id='',reservation_id='r-b9g339lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1815478259',owner_user_name='tempest-VolumesSnapshotTestJSON-1815478259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:58:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c01f25553f947d781c9c8b8a0953203',uuid=af65cc0f-3880-4df7-8c62-61efbcc110fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converting VIF {"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:c6,bridge_name='br-int',has_traffic_filtering=True,id=a7ccfecd-5875-4e4f-9780-15250fd24876,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ccfecd-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'pci_devices' on Instance uuid af65cc0f-3880-4df7-8c62-61efbcc110fa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:58:02 user nova-compute[75216]:   <uuid>af65cc0f-3880-4df7-8c62-61efbcc110fa</uuid>
Nov 02 04:58:02 user nova-compute[75216]:   <name>instance-0000001f</name>
Nov 02 04:58:02 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:58:02 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:58:02 user nova-compute[75216]:   <metadata>
Nov 02 04:58:02 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:58:02 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:58:02 user nova-compute[75216]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1866729633</nova:name>
Nov 02 04:58:02 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:58:02</nova:creationTime>
Nov 02 04:58:02 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:58:02 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:58:02 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:58:02 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:58:02 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:58:02 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:58:02 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:58:02 user nova-compute[75216]:       <nova:owner>
Nov 02 04:58:02 user nova-compute[75216]:         <nova:user uuid="7c01f25553f947d781c9c8b8a0953203">tempest-VolumesSnapshotTestJSON-1815478259-project-member</nova:user>
Nov 02 04:58:02 user nova-compute[75216]:         <nova:project uuid="65b49d78b7cd47db8284e82230b2237f">tempest-VolumesSnapshotTestJSON-1815478259</nova:project>
Nov 02 04:58:02 user nova-compute[75216]:       </nova:owner>
Nov 02 04:58:02 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:58:02 user nova-compute[75216]:       <nova:ports>
Nov 02 04:58:02 user nova-compute[75216]:         <nova:port uuid="a7ccfecd-5875-4e4f-9780-15250fd24876">
Nov 02 04:58:02 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 04:58:02 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:02 user nova-compute[75216]:       </nova:ports>
Nov 02 04:58:02 user nova-compute[75216]:     </nova:instance>
Nov 02 04:58:02 user nova-compute[75216]:   </metadata>
Nov 02 04:58:02 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:58:02 user nova-compute[75216]:     <system>
Nov 02 04:58:02 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:58:02 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:58:02 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:58:02 user nova-compute[75216]:       <entry name="serial">af65cc0f-3880-4df7-8c62-61efbcc110fa</entry>
Nov 02 04:58:02 user nova-compute[75216]:       <entry name="uuid">af65cc0f-3880-4df7-8c62-61efbcc110fa</entry>
Nov 02 04:58:02 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:58:02 user nova-compute[75216]:     </system>
Nov 02 04:58:02 user nova-compute[75216]:   </sysinfo>
Nov 02 04:58:02 user nova-compute[75216]:   <os>
Nov 02 04:58:02 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:58:02 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:58:02 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:58:02 user nova-compute[75216]:   </os>
Nov 02 04:58:02 user nova-compute[75216]:   <features>
Nov 02 04:58:02 user nova-compute[75216]:     <acpi/>
Nov 02 04:58:02 user nova-compute[75216]:     <apic/>
Nov 02 04:58:02 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:58:02 user nova-compute[75216]:   </features>
Nov 02 04:58:02 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:58:02 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:58:02 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:58:02 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:58:02 user nova-compute[75216]:   </clock>
Nov 02 04:58:02 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:58:02 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:58:02 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:58:02 user nova-compute[75216]:   </cpu>
Nov 02 04:58:02 user nova-compute[75216]:   <devices>
Nov 02 04:58:02 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 04:58:02 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 04:58:02 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk"/>
Nov 02 04:58:02 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:58:02 user nova-compute[75216]:     </disk>
Nov 02 04:58:02 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:02 user nova-compute[75216]:       <mac address="fa:16:3e:a7:84:c6"/>
Nov 02 04:58:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:02 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:02 user nova-compute[75216]:       <target dev="tapa7ccfecd-58"/>
Nov 02 04:58:02 user nova-compute[75216]:     </interface>
Nov 02 04:58:02 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:58:02 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/console.log" append="off"/>
Nov 02 04:58:02 user nova-compute[75216]:     </serial>
Nov 02 04:58:02 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:58:02 user nova-compute[75216]:     <video>
Nov 02 04:58:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:02 user nova-compute[75216]:     </video>
Nov 02 04:58:02 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:58:02 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:58:02 user nova-compute[75216]:     </rng>
Nov 02 04:58:02 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:58:02 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:58:02 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:58:02 user nova-compute[75216]:     </memballoon>
Nov 02 04:58:02 user nova-compute[75216]:   </devices>
Nov 02 04:58:02 user nova-compute[75216]: </domain>
Nov 02 04:58:02 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1866729633',display_name='tempest-VolumesSnapshotTestJSON-instance-1866729633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1866729633',id=31,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0CghsnCRqCQ5dJUL2f470G7WiwFcEtwKLwbx8rDrhugToShkpBJRNcWmNYuAHT9SEFG2+VB3jL2o1ptXgXJc2Qf0h7rSF5qANVJbT71zCSNf69QzHSEh5/T4wUA2vo1w==',key_name='tempest-keypair-1925365009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65b49d78b7cd47db8284e82230b2237f',ramdisk_id='',reservation_id='r-b9g339lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1815478259',owner_user_name='tempest-VolumesSnapshotTestJSON-1815478259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:58:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c01f25553f947d781c9c8b8a0953203',uuid=af65cc0f-3880-4df7-8c62-61efbcc110fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converting VIF {"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:c6,bridge_name='br-int',has_traffic_filtering=True,id=a7ccfecd-5875-4e4f-9780-15250fd24876,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ccfecd-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG os_vif [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:c6,bridge_name='br-int',has_traffic_filtering=True,id=a7ccfecd-5875-4e4f-9780-15250fd24876,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ccfecd-58') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28d53631-cb94-51f0-9386-38f9e6cd4c03', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7ccfecd-58, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7ccfecd-58, col_values=(('qos', UUID('a99827d7-4b92-4051-a85e-a2ee53d735a5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7ccfecd-58, col_values=(('external_ids', {'iface-id': 'a7ccfecd-5875-4e4f-9780-15250fd24876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:84:c6', 'vm-uuid': 'af65cc0f-3880-4df7-8c62-61efbcc110fa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:02 user nova-compute[75216]: INFO os_vif [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:c6,bridge_name='br-int',has_traffic_filtering=True,id=a7ccfecd-5875-4e4f-9780-15250fd24876,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ccfecd-58')
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] No VIF found with MAC fa:16:3e:a7:84:c6, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:58:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Updated VIF entry in instance network info cache for port a7ccfecd-5875-4e4f-9780-15250fd24876. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:58:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Updating instance_info_cache with network_info: [{"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:58:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6aa89811-bb35-4c1e-80e2-152d95b43c41 req-5e650f00-12f8-4196-963f-db0cc808c032 service nova] Releasing lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-c1933d35-9833-4cd0-86eb-3dea4511135e req-6577cbd1-3922-4a7b-b315-dbadb7fd4327 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1933d35-9833-4cd0-86eb-3dea4511135e req-6577cbd1-3922-4a7b-b315-dbadb7fd4327 service nova] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1933d35-9833-4cd0-86eb-3dea4511135e req-6577cbd1-3922-4a7b-b315-dbadb7fd4327 service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1933d35-9833-4cd0-86eb-3dea4511135e req-6577cbd1-3922-4a7b-b315-dbadb7fd4327 service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-c1933d35-9833-4cd0-86eb-3dea4511135e req-6577cbd1-3922-4a7b-b315-dbadb7fd4327 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] No waiting events found dispatching network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:04 user nova-compute[75216]: WARNING nova.compute.manager [req-c1933d35-9833-4cd0-86eb-3dea4511135e req-6577cbd1-3922-4a7b-b315-dbadb7fd4327 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received unexpected event network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 for instance with vm_state building and task_state spawning.
Nov 02 04:58:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:58:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Instance spawned successfully.
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ccfe90d-175a-499f-bedd-61b39a0f4bd8 req-e92c35e5-87f2-4d7f-95d3-a6784b94b2ba service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ccfe90d-175a-499f-bedd-61b39a0f4bd8 req-e92c35e5-87f2-4d7f-95d3-a6784b94b2ba service nova] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ccfe90d-175a-499f-bedd-61b39a0f4bd8 req-e92c35e5-87f2-4d7f-95d3-a6784b94b2ba service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ccfe90d-175a-499f-bedd-61b39a0f4bd8 req-e92c35e5-87f2-4d7f-95d3-a6784b94b2ba service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ccfe90d-175a-499f-bedd-61b39a0f4bd8 req-e92c35e5-87f2-4d7f-95d3-a6784b94b2ba service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] No waiting events found dispatching network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:06 user nova-compute[75216]: WARNING nova.compute.manager [req-2ccfe90d-175a-499f-bedd-61b39a0f4bd8 req-e92c35e5-87f2-4d7f-95d3-a6784b94b2ba service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received unexpected event network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 for instance with vm_state building and task_state spawning.
Nov 02 04:58:06 user nova-compute[75216]: INFO nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 02 04:58:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:58:06 user nova-compute[75216]: INFO nova.compute.manager [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Took 6.86 seconds to build instance.
Nov 02 04:58:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f0ee0cb-7f53-4f35-a7eb-f40d642b39e6 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.981s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-changed-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Refreshing instance network info cache due to event network-changed-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] Acquiring lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] Acquired lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Refreshing network info cache for port 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:09 user nova-compute[75216]: INFO nova.compute.manager [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Terminating instance
Nov 02 04:58:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updated VIF entry in instance network info cache for port 8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updating instance_info_cache with network_info: [{"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-77c02b3e-8e81-450e-8b93-e9dafee5c2e4 req-cd35e5bf-9ba3-4e5d-9168-511463aa32aa service nova] Releasing lock "refresh_cache-5da51a4a-9605-4c02-b3cb-367fafba296f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Instance destroyed successfully.
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lazy-loading 'resources' on Instance uuid 5da51a4a-9605-4c02-b3cb-367fafba296f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-718097847',display_name='tempest-TestStampPattern-server-718097847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-718097847',id=15,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsRzP3Sg+sJdhvi68MNNzT62rX+Rvtkulq7b2aqFAXRvz/PCDywk8i0/3Qn3hw8DO0i8lgHEo5/PcGZcK4FS6lQGDpD4OwaBWQCg1f0tC4Nct4Wx2de+2XNa4rN9Rx48A==',key_name='tempest-TestStampPattern-2044657716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:50:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6b5ff67267c443b81b9472b5d5560ab',ramdisk_id='',reservation_id='r-0lmlv400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-774067185',owner_user_name='tempest-TestStampPattern-774067185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:53:38Z,user_data=None,user_id='2e06c15a638245d2825317e30721ebd1',uuid=5da51a4a-9605-4c02-b3cb-367fafba296f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converting VIF {"id": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "address": "fa:16:3e:14:d4:fc", "network": {"id": "91f12b95-a38a-4e5d-af78-f3940390494f", "bridge": "br-int", "label": "tempest-TestStampPattern-1763126718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6b5ff67267c443b81b9472b5d5560ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7ca30-f6", "ovs_interfaceid": "8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:d4:fc,bridge_name='br-int',has_traffic_filtering=True,id=8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7ca30-f6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG os_vif [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:d4:fc,bridge_name='br-int',has_traffic_filtering=True,id=8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7ca30-f6') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ee7ca30-f6, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fea0644-cfdb-48cc-91a1-992611e493c5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:10 user nova-compute[75216]: INFO os_vif [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:d4:fc,bridge_name='br-int',has_traffic_filtering=True,id=8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58,network=Network(91f12b95-a38a-4e5d-af78-f3940390494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7ca30-f6')
Nov 02 04:58:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Deleting instance files /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f_del
Nov 02 04:58:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Deletion of /opt/stack/data/nova/instances/5da51a4a-9605-4c02-b3cb-367fafba296f_del complete
Nov 02 04:58:10 user nova-compute[75216]: INFO nova.compute.manager [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 02 04:58:10 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:58:11 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Took 0.53 seconds to deallocate network for instance.
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-e24e9678-bc2d-43ce-9da0-0d045ef577ac req-e60006d0-5704-492a-bb43-f0c906422c6a service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-vif-deleted-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-vif-unplugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] No waiting events found dispatching network-vif-unplugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:11 user nova-compute[75216]: WARNING nova.compute.manager [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received unexpected event network-vif-unplugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 for instance with vm_state deleted and task_state None.
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received event network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] Acquiring lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] No waiting events found dispatching network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:11 user nova-compute[75216]: WARNING nova.compute.manager [req-9300f5e0-b6be-42c6-b2fb-b8ead34766db req-d7412ceb-4d1b-49c7-9bc9-c287b4b24666 service nova] [instance: 5da51a4a-9605-4c02-b3cb-367fafba296f] Received unexpected event network-vif-plugged-8ee7ca30-f6ff-4c49-acf8-a6d89b76cf58 for instance with vm_state deleted and task_state None.
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:12 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Deleted allocations for instance 5da51a4a-9605-4c02-b3cb-367fafba296f
Nov 02 04:58:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63d079a1-8779-4c3b-b270-b3a81a303868 tempest-TestStampPattern-774067185 tempest-TestStampPattern-774067185-project-member] Lock "5da51a4a-9605-4c02-b3cb-367fafba296f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 is timed out.
Nov 02 04:58:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully detached device vdb from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the live domain config.
Nov 02 04:58:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anroElvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:58:17 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb41b68-bed8-4553-8da7-b6cbabaf9483]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:58:17 user nova-compute[75216]: No targets found.
Nov 02 04:58:17 user nova-compute[75216]: iSNS:
Nov 02 04:58:17 user nova-compute[75216]: No targets found.
Nov 02 04:58:17 user nova-compute[75216]: STATIC:
Nov 02 04:58:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:58:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c
Nov 02 04:58:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac
Nov 02 04:58:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:58:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0
Nov 02 04:58:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:58:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:17 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:17 user nova-compute[75216]: FIRMWARE:
Nov 02 04:58:17 user nova-compute[75216]: No targets found.
Nov 02 04:58:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:58:17 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:58:17 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd7906-9da0-4033-9057-5e4d8336aa1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a5a3d-2f20-4a33-94a3-cc7898683e1d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:17 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec341fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e78d60a-6290-4b73-9519-b965cc6d30f6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f894690-987d-4a6d-a6f7-5970b977f9ba]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[65867232-385e-4114-956f-10ea7c134029]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13ffd38-ecfc-4e40-8b92-befa72db3e15]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d738ae-d4f3-4a35-8a72-20d7af56d32b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa9099b-35f5-419b-9c49-ecfbcd9bd720]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260]
Nov 02 04:58:17 user nova-compute[75216]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c, portal: 172.16.0.220,3260] successful.
Nov 02 04:58:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c275706-92e9-49cb-b68c-5305d1572b3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78d7b0e-ba14-4842-a5a3-939ff55645fa]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== disconnect_volume: return (379ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:58:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:58:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=24.92115020751953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9d70d083-152e-41b7-ac2f-bf525b92593b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 48c33b8f-cdd5-452e-9c39-3e5504db6b1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4da30dfe-3083-4e6c-a3bf-a85eb11d48de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance bf29e71d-bdea-49a2-9640-5fb7bc9ff72f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance af65cc0f-3880-4df7-8c62-61efbcc110fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:58:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:58:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:58:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:58:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:58:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:58:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:58:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:58:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:58:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:58:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0d49424-068a-45a9-82d9-7bfbd5ad054a tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.425s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 04:58:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Creating image(s)
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Ensure instance console log exists: /opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Start _get_guest_xml network_info=[{"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '4f4c202e-7808-4e6c-bc09-54e6c2fc15a9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKOhdzrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de', 'attached_at': '', 'detached_at': '', 'volume_id': '23e0ecc7-7922-425d-b28c-e95ff1eae48a', 'serial': '23e0ecc7-7922-425d-b28c-e95ff1eae48a'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '2703cd55-45dc-465d-a327-e365fea4f51f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deoksDuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9653497-568d-4be0-b250-516eac053abf', 'serial': 'f9653497-568d-4be0-b250-516eac053abf'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': 'af0d9f86-eea7-4bcc-8703-d7cedf7882c3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLajxEZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de', 'attached_at': '', 'detached_at': '', 'volume_id': '93672707-7936-4c52-9f52-4eef05b3e8ce', 'serial': '93672707-7936-4c52-9f52-4eef05b3e8ce'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 04:58:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:58:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKOhdzrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:58:25 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:25 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:25 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b4d8ae-b9cb-432b-9443-b5c804508549]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:58:25 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7704f0ae-8904-4822-abf1-edd77f985c38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a] added
Nov 02 04:58:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[89af85bf-ac78-45e4-9516-909fb9e837b2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd0b6cf-d651-4215-ac9b-93724ca3e82f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eKOhdzrT {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eKOhdzrT" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ac4fa0-3378-4b46-961e-3fcc8879f007]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eKOhdzrT'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7912b5bc-1b77-4f57-bfb2-eecfd64b1f1e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86ed37-a680-4ee0-979c-d494619e1fa5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b9e6ac-1135-460d-bfe1-fc50f00f8a00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260]
Nov 02 04:58:25 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260] successful.
Nov 02 04:58:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e8b44-46c6-4313-9783-2d372ea7b759]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf2bc1-0986-46aa-9676-e3733dccb3fd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:25 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2375409-19eb-4c45-bff1-cf67a522fded]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKOhdzrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:25 user nova-compute[75216]: INFO nova.compute.manager [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Detaching volume 5a1028ef-cd2a-4842-9c0c-16df9275dae0
Nov 02 04:58:25 user nova-compute[75216]: INFO nova.virt.block_device [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Attempting to driver detach volume 5a1028ef-cd2a-4842-9c0c-16df9275dae0 from mountpoint /dev/vdc
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Attempting to detach device vdc from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:58:25 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:58:25 user nova-compute[75216]:   <source dev="/dev/sdg"/>
Nov 02 04:58:25 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 04:58:25 user nova-compute[75216]:   <serial>5a1028ef-cd2a-4842-9c0c-16df9275dae0</serial>
Nov 02 04:58:25 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 04:58:25 user nova-compute[75216]: </disk>
Nov 02 04:58:25 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:58:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully detached device vdc from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the persistent domain config.
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:58:25 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:58:25 user nova-compute[75216]:   <source dev="/dev/sdg"/>
Nov 02 04:58:25 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 04:58:25 user nova-compute[75216]:   <serial>5a1028ef-cd2a-4842-9c0c-16df9275dae0</serial>
Nov 02 04:58:25 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 04:58:25 user nova-compute[75216]: </disk>
Nov 02 04:58:25 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:58:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23061356638633762', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061356638633762', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deoksDuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:58:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:26 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:26 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d0b31-c3e8-46fb-8d73-259c517c09f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:58:26 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7384862e-24a2-42f4-b039-a6d4d652127c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf] added
Nov 02 04:58:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8d806c-13cc-4224-823b-951905a0ae05]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abfab74-403a-47f0-b1d6-9552b9ca96dc]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deoksDuS {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deoksDuS" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98faa834-b970-4afb-a3e0-e5df1ccc41c1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'deoksDuS'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ca83b-a9d0-4b13-adf7-8243e943ddd9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89005cb-0e7a-4389-9acf-0b00ead8c225]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[943f49d9-1274-40e7-ab58-01cd3ccad36d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260]
Nov 02 04:58:26 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260] successful.
Nov 02 04:58:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ffd0a9-80b0-4c04-a697-f3eb66b885b9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b81e1-9ce5-409f-bd57-90ee84fe8400]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:26 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f14ee3-177a-4fa1-a850-abe16c76e75e]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:58:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deoksDuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26161393333636134', 'path': '/dev/sdh'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161393333636134', 'path': '/dev/sdh'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLajxEZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:58:28 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:28 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:28 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7401ee-f007-4d75-b20b-bfa78f6a0923]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:58:28 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef359fbd-ce33-465a-963e-c271d38898a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce] added
Nov 02 04:58:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b8cb2b-d403-4b4a-b09b-bc2b93c6bd4f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3afcfa-123c-42c1-b02c-00a00944fcda]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLajxEZw {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLajxEZw" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e31ff6-cc0a-4bdb-b36b-7e072f22a4fd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RLajxEZw'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd4d96c-e759-4580-9b1d-410595383419]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8690d102-978a-4b49-992a-de302a6f9f69]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d1af9-7633-4299-acd1-65dbe879b3ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260]
Nov 02 04:58:28 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260] successful.
Nov 02 04:58:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d15a7e-968c-4477-9858-7139370cb71e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90d3d55-0be1-489c-a032-c763ad822511]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:58:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:28 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:58:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] HCTL ('40', '-', '-', 0) found on session 34 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81c646d-84e9-4248-aac1-f128f95398d4]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLajxEZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23931366164396566', 'path': '/dev/sdi'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931366164396566', 'path': '/dev/sdi'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:1d,bridge_name='br-int',has_traffic_filtering=True,id=61b6718e-9c4b-462c-af56-b2117e8b8662,network=Network(cfa1a434-8af7-4ea3-a359-6c57d17bf5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61b6718e-9c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:72:31,bridge_name='br-int',has_traffic_filtering=True,id=c4e822fa-4b56-4530-b90a-7d867c7b8ed8,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc4e822fa-4b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=393a501b-cb81-4fe3-83fe-7f2bf2da0be5,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap393a501b-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a94ae3f0-817a-4943-ad82-a7efa70d15b6,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94ae3f0-81') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:3b:02,bridge_name='br-int',has_traffic_filtering=True,id=849bcaec-1bf2-4b87-9b70-7e728cec0154,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap849bcaec-1b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:29,bridge_name='br-int',has_traffic_filtering=True,id=fbb09594-5665-4640-abe0-c1d499c48230,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb09594-56') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3a:fe,bridge_name='br-int',has_traffic_filtering=True,id=18f60d6e-e06b-4c32-81e9-6a027fb7d909,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f60d6e-e0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lazy-loading 'pci_devices' on Instance uuid 4da30dfe-3083-4e6c-a3bf-a85eb11d48de {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] End _get_guest_xml xml=<domain type="kvm">
Nov 02 04:58:29 user nova-compute[75216]:   <uuid>4da30dfe-3083-4e6c-a3bf-a85eb11d48de</uuid>
Nov 02 04:58:29 user nova-compute[75216]:   <name>instance-0000001e</name>
Nov 02 04:58:29 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 04:58:29 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 04:58:29 user nova-compute[75216]:   <metadata>
Nov 02 04:58:29 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 04:58:29 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 04:58:29 user nova-compute[75216]:       <nova:name>tempest-device-tagging-server-1776230610</nova:name>
Nov 02 04:58:29 user nova-compute[75216]:       <nova:creationTime>2023-11-02 04:58:25</nova:creationTime>
Nov 02 04:58:29 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 04:58:29 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 04:58:29 user nova-compute[75216]:       </nova:flavor>
Nov 02 04:58:29 user nova-compute[75216]:       <nova:owner>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:user uuid="0647ffce9f894d59ac9bd8509c79393b">tempest-TaggedBootDevicesTest_v242-719347030-project-member</nova:user>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:project uuid="c94946efcb3b4b49967b47d62446269c">tempest-TaggedBootDevicesTest_v242-719347030</nova:project>
Nov 02 04:58:29 user nova-compute[75216]:       </nova:owner>
Nov 02 04:58:29 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 04:58:29 user nova-compute[75216]:       <nova:ports>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:port uuid="61b6718e-9c4b-462c-af56-b2117e8b8662">
Nov 02 04:58:29 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 04:58:29 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:port uuid="c4e822fa-4b56-4530-b90a-7d867c7b8ed8">
Nov 02 04:58:29 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Nov 02 04:58:29 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:port uuid="393a501b-cb81-4fe3-83fe-7f2bf2da0be5">
Nov 02 04:58:29 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Nov 02 04:58:29 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:port uuid="a94ae3f0-817a-4943-ad82-a7efa70d15b6">
Nov 02 04:58:29 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 02 04:58:29 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:port uuid="849bcaec-1bf2-4b87-9b70-7e728cec0154">
Nov 02 04:58:29 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Nov 02 04:58:29 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:port uuid="fbb09594-5665-4640-abe0-c1d499c48230">
Nov 02 04:58:29 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 04:58:29 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:29 user nova-compute[75216]:         <nova:port uuid="18f60d6e-e06b-4c32-81e9-6a027fb7d909">
Nov 02 04:58:29 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 04:58:29 user nova-compute[75216]:         </nova:port>
Nov 02 04:58:29 user nova-compute[75216]:       </nova:ports>
Nov 02 04:58:29 user nova-compute[75216]:     </nova:instance>
Nov 02 04:58:29 user nova-compute[75216]:   </metadata>
Nov 02 04:58:29 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 04:58:29 user nova-compute[75216]:     <system>
Nov 02 04:58:29 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 04:58:29 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 04:58:29 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 04:58:29 user nova-compute[75216]:       <entry name="serial">4da30dfe-3083-4e6c-a3bf-a85eb11d48de</entry>
Nov 02 04:58:29 user nova-compute[75216]:       <entry name="uuid">4da30dfe-3083-4e6c-a3bf-a85eb11d48de</entry>
Nov 02 04:58:29 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 04:58:29 user nova-compute[75216]:     </system>
Nov 02 04:58:29 user nova-compute[75216]:   </sysinfo>
Nov 02 04:58:29 user nova-compute[75216]:   <os>
Nov 02 04:58:29 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 04:58:29 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 04:58:29 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 04:58:29 user nova-compute[75216]:   </os>
Nov 02 04:58:29 user nova-compute[75216]:   <features>
Nov 02 04:58:29 user nova-compute[75216]:     <acpi/>
Nov 02 04:58:29 user nova-compute[75216]:     <apic/>
Nov 02 04:58:29 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 04:58:29 user nova-compute[75216]:   </features>
Nov 02 04:58:29 user nova-compute[75216]:   <clock offset="utc">
Nov 02 04:58:29 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 04:58:29 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 04:58:29 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 04:58:29 user nova-compute[75216]:   </clock>
Nov 02 04:58:29 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 04:58:29 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 04:58:29 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 04:58:29 user nova-compute[75216]:   </cpu>
Nov 02 04:58:29 user nova-compute[75216]:   <devices>
Nov 02 04:58:29 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 02 04:58:29 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 04:58:29 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de/disk.config"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="hda" bus="ide"/>
Nov 02 04:58:29 user nova-compute[75216]:     </disk>
Nov 02 04:58:29 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:58:29 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:58:29 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <serial>23e0ecc7-7922-425d-b28c-e95ff1eae48a</serial>
Nov 02 04:58:29 user nova-compute[75216]:     </disk>
Nov 02 04:58:29 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:58:29 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:58:29 user nova-compute[75216]:       <source dev="/dev/sdh"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <serial>f9653497-568d-4be0-b250-516eac053abf</serial>
Nov 02 04:58:29 user nova-compute[75216]:     </disk>
Nov 02 04:58:29 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 04:58:29 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:58:29 user nova-compute[75216]:       <source dev="/dev/sdi"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="vdc" bus="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <serial>93672707-7936-4c52-9f52-4eef05b3e8ce</serial>
Nov 02 04:58:29 user nova-compute[75216]:     </disk>
Nov 02 04:58:29 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:29 user nova-compute[75216]:       <mac address="fa:16:3e:c9:2c:1d"/>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="tap61b6718e-9c"/>
Nov 02 04:58:29 user nova-compute[75216]:     </interface>
Nov 02 04:58:29 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:29 user nova-compute[75216]:       <mac address="fa:16:3e:90:72:31"/>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="tapc4e822fa-4b"/>
Nov 02 04:58:29 user nova-compute[75216]:     </interface>
Nov 02 04:58:29 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:29 user nova-compute[75216]:       <mac address="fa:16:3e:d4:0d:d3"/>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="tap393a501b-cb"/>
Nov 02 04:58:29 user nova-compute[75216]:     </interface>
Nov 02 04:58:29 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:29 user nova-compute[75216]:       <mac address="fa:16:3e:1c:8d:fb"/>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="tapa94ae3f0-81"/>
Nov 02 04:58:29 user nova-compute[75216]:     </interface>
Nov 02 04:58:29 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:29 user nova-compute[75216]:       <mac address="fa:16:3e:50:3b:02"/>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="tap849bcaec-1b"/>
Nov 02 04:58:29 user nova-compute[75216]:     </interface>
Nov 02 04:58:29 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:29 user nova-compute[75216]:       <mac address="fa:16:3e:90:ea:29"/>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="tapfbb09594-56"/>
Nov 02 04:58:29 user nova-compute[75216]:     </interface>
Nov 02 04:58:29 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 04:58:29 user nova-compute[75216]:       <mac address="fa:16:3e:0e:3a:fe"/>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 04:58:29 user nova-compute[75216]:       <target dev="tap18f60d6e-e0"/>
Nov 02 04:58:29 user nova-compute[75216]:     </interface>
Nov 02 04:58:29 user nova-compute[75216]:     <serial type="pty">
Nov 02 04:58:29 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de/console.log" append="off"/>
Nov 02 04:58:29 user nova-compute[75216]:     </serial>
Nov 02 04:58:29 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 04:58:29 user nova-compute[75216]:     <video>
Nov 02 04:58:29 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 04:58:29 user nova-compute[75216]:     </video>
Nov 02 04:58:29 user nova-compute[75216]:     <rng model="virtio">
Nov 02 04:58:29 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 04:58:29 user nova-compute[75216]:     </rng>
Nov 02 04:58:29 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 04:58:29 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 04:58:29 user nova-compute[75216]:       <stats period="10"/>
Nov 02 04:58:29 user nova-compute[75216]:     </memballoon>
Nov 02 04:58:29 user nova-compute[75216]:   </devices>
Nov 02 04:58:29 user nova-compute[75216]: </domain>
Nov 02 04:58:29 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:1d,bridge_name='br-int',has_traffic_filtering=True,id=61b6718e-9c4b-462c-af56-b2117e8b8662,network=Network(cfa1a434-8af7-4ea3-a359-6c57d17bf5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61b6718e-9c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:1d,bridge_name='br-int',has_traffic_filtering=True,id=61b6718e-9c4b-462c-af56-b2117e8b8662,network=Network(cfa1a434-8af7-4ea3-a359-6c57d17bf5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61b6718e-9c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18075ad3-8e9a-5b35-aa9a-4933f3799ffa', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61b6718e-9c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61b6718e-9c, col_values=(('qos', UUID('c7f1f9e1-5183-4651-b2b2-1ca249abce7b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61b6718e-9c, col_values=(('external_ids', {'iface-id': '61b6718e-9c4b-462c-af56-b2117e8b8662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:2c:1d', 'vm-uuid': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: INFO os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:1d,bridge_name='br-int',has_traffic_filtering=True,id=61b6718e-9c4b-462c-af56-b2117e8b8662,network=Network(cfa1a434-8af7-4ea3-a359-6c57d17bf5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61b6718e-9c')
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:72:31,bridge_name='br-int',has_traffic_filtering=True,id=c4e822fa-4b56-4530-b90a-7d867c7b8ed8,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc4e822fa-4b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:72:31,bridge_name='br-int',has_traffic_filtering=True,id=c4e822fa-4b56-4530-b90a-7d867c7b8ed8,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc4e822fa-4b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08c00b46-4a02-5993-8b00-741bb1dfc7d6', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4e822fa-4b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4e822fa-4b, col_values=(('qos', UUID('9b467b14-5a1b-4ef3-9903-c92912dbe7ce')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4e822fa-4b, col_values=(('external_ids', {'iface-id': 'c4e822fa-4b56-4530-b90a-7d867c7b8ed8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:72:31', 'vm-uuid': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: INFO os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:72:31,bridge_name='br-int',has_traffic_filtering=True,id=c4e822fa-4b56-4530-b90a-7d867c7b8ed8,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc4e822fa-4b')
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=393a501b-cb81-4fe3-83fe-7f2bf2da0be5,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap393a501b-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=393a501b-cb81-4fe3-83fe-7f2bf2da0be5,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap393a501b-cb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3e437c6-6cc4-548c-9e0a-3740359afb80', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap393a501b-cb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap393a501b-cb, col_values=(('qos', UUID('51dd1802-7999-430b-b017-6c1b798cecc5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap393a501b-cb, col_values=(('external_ids', {'iface-id': '393a501b-cb81-4fe3-83fe-7f2bf2da0be5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:0d:d3', 'vm-uuid': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: INFO os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=393a501b-cb81-4fe3-83fe-7f2bf2da0be5,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap393a501b-cb')
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a94ae3f0-817a-4943-ad82-a7efa70d15b6,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94ae3f0-81') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a94ae3f0-817a-4943-ad82-a7efa70d15b6,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94ae3f0-81') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bcb2d3b-601a-5c4f-a81b-580c49d732ec', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa94ae3f0-81, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa94ae3f0-81, col_values=(('qos', UUID('6a5239ab-48c0-47b6-ae23-988f420523e1')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa94ae3f0-81, col_values=(('external_ids', {'iface-id': 'a94ae3f0-817a-4943-ad82-a7efa70d15b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:8d:fb', 'vm-uuid': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: INFO os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a94ae3f0-817a-4943-ad82-a7efa70d15b6,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94ae3f0-81')
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:3b:02,bridge_name='br-int',has_traffic_filtering=True,id=849bcaec-1bf2-4b87-9b70-7e728cec0154,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap849bcaec-1b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:3b:02,bridge_name='br-int',has_traffic_filtering=True,id=849bcaec-1bf2-4b87-9b70-7e728cec0154,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap849bcaec-1b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1f1b541-a8eb-519f-bc89-8b9931b56f6d', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap849bcaec-1b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap849bcaec-1b, col_values=(('qos', UUID('ab752aab-2352-4bd8-855b-9a2d6cc31cdd')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap849bcaec-1b, col_values=(('external_ids', {'iface-id': '849bcaec-1bf2-4b87-9b70-7e728cec0154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:3b:02', 'vm-uuid': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: INFO os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:3b:02,bridge_name='br-int',has_traffic_filtering=True,id=849bcaec-1bf2-4b87-9b70-7e728cec0154,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap849bcaec-1b')
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:29,bridge_name='br-int',has_traffic_filtering=True,id=fbb09594-5665-4640-abe0-c1d499c48230,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb09594-56') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:29,bridge_name='br-int',has_traffic_filtering=True,id=fbb09594-5665-4640-abe0-c1d499c48230,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb09594-56') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85d9994f-6cdf-551d-9b13-08b9191134bf', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbb09594-56, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbb09594-56, col_values=(('qos', UUID('89ef26b1-23f7-4c90-917c-3e7fbcc806ba')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbb09594-56, col_values=(('external_ids', {'iface-id': 'fbb09594-5665-4640-abe0-c1d499c48230', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:ea:29', 'vm-uuid': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: INFO os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:29,bridge_name='br-int',has_traffic_filtering=True,id=fbb09594-5665-4640-abe0-c1d499c48230,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb09594-56')
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T04:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3a:fe,bridge_name='br-int',has_traffic_filtering=True,id=18f60d6e-e06b-4c32-81e9-6a027fb7d909,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f60d6e-e0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3a:fe,bridge_name='br-int',has_traffic_filtering=True,id=18f60d6e-e06b-4c32-81e9-6a027fb7d909,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f60d6e-e0') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9fe6e18-2641-59af-a913-f36d901a62d9', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18f60d6e-e0, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18f60d6e-e0, col_values=(('qos', UUID('34f736fe-6595-41b5-bc1c-c4ce975e57bd')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18f60d6e-e0, col_values=(('external_ids', {'iface-id': '18f60d6e-e06b-4c32-81e9-6a027fb7d909', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:3a:fe', 'vm-uuid': '4da30dfe-3083-4e6c-a3bf-a85eb11d48de'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:58:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:30 user nova-compute[75216]: INFO os_vif [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3a:fe,bridge_name='br-int',has_traffic_filtering=True,id=18f60d6e-e06b-4c32-81e9-6a027fb7d909,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f60d6e-e0')
Nov 02 04:58:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:58:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:58:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] No VIF found with MAC fa:16:3e:c9:2c:1d, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:58:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] No VIF found with MAC fa:16:3e:50:3b:02, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:58:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Using config drive
Nov 02 04:58:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Creating config drive at /opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de/disk.config
Nov 02 04:58:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptx6szd_e {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptx6szd_e" returned: 0 in 0.062s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-f89ce5ad-286e-4924-9975-7bbd562ff5ff req-b68eefd0-4ba4-427a-b47a-bf2434590d2c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f89ce5ad-286e-4924-9975-7bbd562ff5ff req-b68eefd0-4ba4-427a-b47a-bf2434590d2c service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f89ce5ad-286e-4924-9975-7bbd562ff5ff req-b68eefd0-4ba4-427a-b47a-bf2434590d2c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f89ce5ad-286e-4924-9975-7bbd562ff5ff req-b68eefd0-4ba4-427a-b47a-bf2434590d2c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-f89ce5ad-286e-4924-9975-7bbd562ff5ff req-b68eefd0-4ba4-427a-b47a-bf2434590d2c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:32 user nova-compute[75216]: WARNING nova.compute.manager [req-f89ce5ad-286e-4924-9975-7bbd562ff5ff req-b68eefd0-4ba4-427a-b47a-bf2434590d2c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 for instance with vm_state building and task_state spawning.
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6b9445c-429d-4798-a8ec-43e7841fe51a req-8c79b8fc-4d20-4536-a4f0-eec74b03b117 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6b9445c-429d-4798-a8ec-43e7841fe51a req-8c79b8fc-4d20-4536-a4f0-eec74b03b117 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6b9445c-429d-4798-a8ec-43e7841fe51a req-8c79b8fc-4d20-4536-a4f0-eec74b03b117 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6b9445c-429d-4798-a8ec-43e7841fe51a req-8c79b8fc-4d20-4536-a4f0-eec74b03b117 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6b9445c-429d-4798-a8ec-43e7841fe51a req-8c79b8fc-4d20-4536-a4f0-eec74b03b117 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:32 user nova-compute[75216]: WARNING nova.compute.manager [req-e6b9445c-429d-4798-a8ec-43e7841fe51a req-8c79b8fc-4d20-4536-a4f0-eec74b03b117 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 for instance with vm_state building and task_state spawning.
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-158ac530-9e04-45fc-b48b-21201de551ba req-1a5e8bf7-df66-4fba-b19d-cfd2d36eacde service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-158ac530-9e04-45fc-b48b-21201de551ba req-1a5e8bf7-df66-4fba-b19d-cfd2d36eacde service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-158ac530-9e04-45fc-b48b-21201de551ba req-1a5e8bf7-df66-4fba-b19d-cfd2d36eacde service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-158ac530-9e04-45fc-b48b-21201de551ba req-1a5e8bf7-df66-4fba-b19d-cfd2d36eacde service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-158ac530-9e04-45fc-b48b-21201de551ba req-1a5e8bf7-df66-4fba-b19d-cfd2d36eacde service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:32 user nova-compute[75216]: WARNING nova.compute.manager [req-158ac530-9e04-45fc-b48b-21201de551ba req-1a5e8bf7-df66-4fba-b19d-cfd2d36eacde service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 for instance with vm_state building and task_state spawning.
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-10ce21bf-15c3-4a7d-8a89-a5fce4977995 req-0027584b-1376-4fc3-9260-bf7b3edd6161 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10ce21bf-15c3-4a7d-8a89-a5fce4977995 req-0027584b-1376-4fc3-9260-bf7b3edd6161 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10ce21bf-15c3-4a7d-8a89-a5fce4977995 req-0027584b-1376-4fc3-9260-bf7b3edd6161 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10ce21bf-15c3-4a7d-8a89-a5fce4977995 req-0027584b-1376-4fc3-9260-bf7b3edd6161 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-10ce21bf-15c3-4a7d-8a89-a5fce4977995 req-0027584b-1376-4fc3-9260-bf7b3edd6161 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-10ce21bf-15c3-4a7d-8a89-a5fce4977995 req-0027584b-1376-4fc3-9260-bf7b3edd6161 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-98f7bc8e-fd84-414d-ad72-1d77b1541614 req-0649da01-6ef9-4c56-8a20-7ded9fd9f167 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:34 user nova-compute[75216]: WARNING nova.compute.manager [req-aa671dd7-d5b0-46f0-9eba-ac63b84054c5 req-8ac02dcb-aac4-40cd-88de-92f695e0e6e3 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 for instance with vm_state building and task_state spawning.
Nov 02 04:58:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 04:58:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance spawned successfully.
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 04:58:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:36 user nova-compute[75216]: INFO nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Took 10.87 seconds to spawn the instance on the hypervisor.
Nov 02 04:58:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:58:36 user nova-compute[75216]: INFO nova.compute.manager [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Took 95.68 seconds to build instance.
Nov 02 04:58:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1731b256-e2f0-4dff-b6ce-99f87b19e6f2 tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 95.804s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 is timed out.
Nov 02 04:58:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully detached device vdc from instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 from the live domain config.
Nov 02 04:58:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyPEUgMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:58:46 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90e4dbd-98e8-4457-8b0e-377f9fbe0eb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:58:46 user nova-compute[75216]: No targets found.
Nov 02 04:58:46 user nova-compute[75216]: iSNS:
Nov 02 04:58:46 user nova-compute[75216]: No targets found.
Nov 02 04:58:46 user nova-compute[75216]: STATIC:
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:58:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:58:46 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:58:46 user nova-compute[75216]: FIRMWARE:
Nov 02 04:58:46 user nova-compute[75216]: No targets found.
Nov 02 04:58:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:58:46 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:58:46 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ac218-70b3-49c2-a6c9-2ac7c12ca73f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d6c9f6-0397-405a-ab46-bacc33b4c2c2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:58:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:58:46 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:58:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec43f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0'): ({'sdg'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Removing single pathed devices sdg {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24b941-a903-4176-a7a3-9db2fe1d3035]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a6b368-4628-4c10-a1d3-66eff371004a]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Flushing IO for device /dev/sdg {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6729549e-bd39-464b-be15-2285fe18527a]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc361cb-89a0-4775-855c-e8246148d2bf]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7524e0cb-00c2-47ed-8732-15f703210c76]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea63051b-4edb-4175-b8ac-c0b92dd1e38f]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260]
Nov 02 04:58:46 user nova-compute[75216]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0, portal: 172.16.0.220,3260] successful.
Nov 02 04:58:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1028ef-cd2a-4842-9c0c-16df9275dae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2454d5d-42ac-48ad-9974-66df264ad265]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] <== disconnect_volume: return (383ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:58:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:58:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'flavor' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:58:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2d99ac0d-49cc-4bed-a75c-5a7383cb5944 tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.919s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:49 user nova-compute[75216]: INFO nova.compute.manager [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Terminating instance
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-changed-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Refreshing instance network info cache due to event network-changed-ed2f7db0-4989-4640-96c5-b651054973f7. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] Acquiring lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] Acquired lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Refreshing network info cache for port ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-49045d42-b763-43a7-9b6b-2b478949b989 req-9b9188b9-fdcf-452a-a644-0e9b008e5893 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-vif-unplugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49045d42-b763-43a7-9b6b-2b478949b989 req-9b9188b9-fdcf-452a-a644-0e9b008e5893 service nova] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49045d42-b763-43a7-9b6b-2b478949b989 req-9b9188b9-fdcf-452a-a644-0e9b008e5893 service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-49045d42-b763-43a7-9b6b-2b478949b989 req-9b9188b9-fdcf-452a-a644-0e9b008e5893 service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-49045d42-b763-43a7-9b6b-2b478949b989 req-9b9188b9-fdcf-452a-a644-0e9b008e5893 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] No waiting events found dispatching network-vif-unplugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-49045d42-b763-43a7-9b6b-2b478949b989 req-9b9188b9-fdcf-452a-a644-0e9b008e5893 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-vif-unplugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:58:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Instance destroyed successfully.
Nov 02 04:58:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lazy-loading 'resources' on Instance uuid 4e6c5fe6-8947-4e54-be82-18ef5ce897f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:58:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1737428131',display_name='tempest-AttachVolumeTestJSON-server-1737428131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1737428131',id=28,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm2dh7YwFgiSnlSIByUGU6F+c4UzlprOMJdliXEqEh5ZGQUkd9rSiYEVeHv6tM3xo+K6bTRAXTnd7Jc5bvQ3F607gpByK/n1LIB9EhhEVrPlYUjXsnIWC/gQ15jW7HlXA==',key_name='tempest-keypair-1281321974',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8baf55600ee343f2b8a6f94622bf9230',ramdisk_id='',reservation_id='r-g6hpvpd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1577581979',owner_user_name='tempest-AttachVolumeTestJSON-1577581979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5f940bafbf4fb7aa7ace530f7d10c1',uuid=4e6c5fe6-8947-4e54-be82-18ef5ce897f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converting VIF {"id": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "address": "fa:16:3e:ec:e9:31", "network": {"id": "1a3dd533-ab66-46ef-8a09-1176875dbc8d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-213603478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8baf55600ee343f2b8a6f94622bf9230", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb409d9e-cf", "ovs_interfaceid": "bb409d9e-cf0e-492d-a593-90fce1aecad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=bb409d9e-cf0e-492d-a593-90fce1aecad8,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb409d9e-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG os_vif [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=bb409d9e-cf0e-492d-a593-90fce1aecad8,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb409d9e-cf') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb409d9e-cf, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fafac572-58f9-4f81-9396-191f52f7682b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:50 user nova-compute[75216]: INFO os_vif [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=bb409d9e-cf0e-492d-a593-90fce1aecad8,network=Network(1a3dd533-ab66-46ef-8a09-1176875dbc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb409d9e-cf')
Nov 02 04:58:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Deleting instance files /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7_del
Nov 02 04:58:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Deletion of /opt/stack/data/nova/instances/4e6c5fe6-8947-4e54-be82-18ef5ce897f7_del complete
Nov 02 04:58:50 user nova-compute[75216]: INFO nova.compute.manager [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 04:58:50 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Updated VIF entry in instance network info cache for port ed2f7db0-4989-4640-96c5-b651054973f7. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Updating instance_info_cache with network_info: [{"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:58:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01359902-b8a7-4f44-a08a-51cfd8e53dc9 req-39e5ab08-22be-4b81-84de-9d1f7c43002a service nova] Releasing lock "refresh_cache-838dfbb6-38e1-40b0-8c70-31ce4953e285" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:58:51 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Took 0.94 seconds to deallocate network for instance.
Nov 02 04:58:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-71eec19d-d23b-48a3-bb13-aa1cd78ba87f req-64d5b491-53f7-437c-a00f-47c575c6f037 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-71eec19d-d23b-48a3-bb13-aa1cd78ba87f req-64d5b491-53f7-437c-a00f-47c575c6f037 service nova] Acquiring lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-71eec19d-d23b-48a3-bb13-aa1cd78ba87f req-64d5b491-53f7-437c-a00f-47c575c6f037 service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-71eec19d-d23b-48a3-bb13-aa1cd78ba87f req-64d5b491-53f7-437c-a00f-47c575c6f037 service nova] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-71eec19d-d23b-48a3-bb13-aa1cd78ba87f req-64d5b491-53f7-437c-a00f-47c575c6f037 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] No waiting events found dispatching network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:58:51 user nova-compute[75216]: WARNING nova.compute.manager [req-71eec19d-d23b-48a3-bb13-aa1cd78ba87f req-64d5b491-53f7-437c-a00f-47c575c6f037 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received unexpected event network-vif-plugged-bb409d9e-cf0e-492d-a593-90fce1aecad8 for instance with vm_state deleted and task_state None.
Nov 02 04:58:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-71eec19d-d23b-48a3-bb13-aa1cd78ba87f req-64d5b491-53f7-437c-a00f-47c575c6f037 service nova] [instance: 4e6c5fe6-8947-4e54-be82-18ef5ce897f7] Received event network-vif-deleted-bb409d9e-cf0e-492d-a593-90fce1aecad8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:58:51 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Deleted allocations for instance 4e6c5fe6-8947-4e54-be82-18ef5ce897f7
Nov 02 04:58:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1449d0f3-8563-4bf5-9fff-21489d2d2e4e tempest-AttachVolumeTestJSON-1577581979 tempest-AttachVolumeTestJSON-1577581979-project-member] Lock "4e6c5fe6-8947-4e54-be82-18ef5ce897f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.585s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lazy-loading 'flavor' on Instance uuid 838dfbb6-38e1-40b0-8c70-31ce4953e285 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:58:57 user nova-compute[75216]: INFO nova.compute.manager [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Attaching volume 059b5336-b4b4-4608-a03f-8c7267d57191 to /dev/vdb
Nov 02 04:58:57 user nova-compute[75216]: DEBUG os_brick.utils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0bbd98-58d4-4d17-a7fa-9e645d02e406]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6bab4-499f-47b0-825f-00b6302c2462]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d613d52d-9949-40e3-92f7-64d0395a81a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5614937f-0b0f-40e4-b61c-99de21049ca8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:58:57 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:58:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0962c8b6-e288-4119-879a-b8279ff7d86b]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG os_brick.utils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:58:57 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Updating existing volume attachment record: 36831d94-c53c-4d50-a9a5-df61adef91bf {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:59:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing instance network info cache due to event network-changed-a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] Acquiring lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] Acquired lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Refreshing network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:11 user nova-compute[75216]: INFO nova.compute.manager [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Terminating instance
Nov 02 04:59:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-c1d61387-85ba-4cec-9197-3e2de7f5cc2b req-9f66f202-4618-478a-926e-d16889de8064 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1d61387-85ba-4cec-9197-3e2de7f5cc2b req-9f66f202-4618-478a-926e-d16889de8064 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1d61387-85ba-4cec-9197-3e2de7f5cc2b req-9f66f202-4618-478a-926e-d16889de8064 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1d61387-85ba-4cec-9197-3e2de7f5cc2b req-9f66f202-4618-478a-926e-d16889de8064 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-c1d61387-85ba-4cec-9197-3e2de7f5cc2b req-9f66f202-4618-478a-926e-d16889de8064 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-c1d61387-85ba-4cec-9197-3e2de7f5cc2b req-9f66f202-4618-478a-926e-d16889de8064 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-unplugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Instance destroyed successfully.
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lazy-loading 'resources' on Instance uuid bf29e71d-bdea-49a2-9640-5fb7bc9ff72f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1658344299',display_name='tempest-TestShelveInstance-server-1658344299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1658344299',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR2e7O3g+/yfvhFEGDrml2dxdAl7kHa14iolyIEUwDVIRS7NkIFi50QeWJpS40VrFqitAVFd7y/IHiVBAniowp1ZvmQoZ5SWx6/ECJfuV/DKXNxdNFoSJPIaNuhvrkMmg==',key_name='tempest-TestShelveInstance-1286148874',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f36dd21f3ea4792a9b68ed89eb31a58',ramdisk_id='',reservation_id='r-zkw0auwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1358632032',owner_user_name='tempest-TestShelveInstance-1358632032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:57:54Z,user_data=None,user_id='e2cc45316cf74e649bdf7d88cf460c6e',uuid=bf29e71d-bdea-49a2-9640-5fb7bc9ff72f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converting VIF {"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_vif [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.network.neutron [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updated VIF entry in instance network info cache for port a399f62c-e5e9-46bd-afae-7261a28b46b3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.network.neutron [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [{"id": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "address": "fa:16:3e:fb:34:c5", "network": {"id": "65e6ca51-324f-44fe-8c60-b73b70045041", "bridge": "br-int", "label": "tempest-TestShelveInstance-1761843622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f36dd21f3ea4792a9b68ed89eb31a58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa399f62c-e5", "ovs_interfaceid": "a399f62c-e5e9-46bd-afae-7261a28b46b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa399f62c-e5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b940873-6999-46bf-a2f6-6e48e049d8ad) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:12 user nova-compute[75216]: INFO os_vif [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:34:c5,bridge_name='br-int',has_traffic_filtering=True,id=a399f62c-e5e9-46bd-afae-7261a28b46b3,network=Network(65e6ca51-324f-44fe-8c60-b73b70045041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa399f62c-e5')
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-33779f86-acf1-4651-bcbe-92be52b4c474 req-389d160d-6f87-4d29-b42b-eb6b100e17a9 service nova] Releasing lock "refresh_cache-bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPWkMNDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:59:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63591afa-d1e7-44d6-93f9-b5ec7449280a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:59:12 user nova-compute[75216]: No targets found.
Nov 02 04:59:12 user nova-compute[75216]: iSNS:
Nov 02 04:59:12 user nova-compute[75216]: No targets found.
Nov 02 04:59:12 user nova-compute[75216]: STATIC:
Nov 02 04:59:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:59:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a
Nov 02 04:59:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac
Nov 02 04:59:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce
Nov 02 04:59:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf
Nov 02 04:59:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:59:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:59:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:12 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:12 user nova-compute[75216]: FIRMWARE:
Nov 02 04:59:12 user nova-compute[75216]: No targets found.
Nov 02 04:59:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:59:12 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:59:12 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b1dc7-ec2b-4095-b01b-3ec3ba63e61d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713437f-8eb7-452b-ae83-788d04e1af42]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:12 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4604268b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f43f999-86a8-4431-935b-1b9921ecf0b5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[65924573-7a37-4cc0-9542-80c11f635ce7]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfddb4f8-9d74-426b-9d87-c79ebb09b609]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1598e24-d765-4679-9fb4-ab447c5f4056]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e043c57d-aafe-4642-9656-5639d578f1c0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e3bfd-2f2c-4e94-a018-f0af1aa4096b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260]
Nov 02 04:59:12 user nova-compute[75216]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac, portal: 172.16.0.220,3260] successful.
Nov 02 04:59:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d01113d-db63-44c0-95df-346152c151ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ee03ee-9267-4280-a28e-cb7b1c8ab84d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] <== disconnect_volume: return (376ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:59:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Deleting instance files /opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f_del
Nov 02 04:59:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Deletion of /opt/stack/data/nova/instances/bf29e71d-bdea-49a2-9640-5fb7bc9ff72f_del complete
Nov 02 04:59:12 user nova-compute[75216]: INFO nova.compute.manager [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 02 04:59:12 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:59:12 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:59:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:13 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Took 0.50 seconds to deallocate network for instance.
Nov 02 04:59:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:13 user nova-compute[75216]: INFO nova.compute.manager [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Unrescuing
Nov 02 04:59:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:59:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquired lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:59:13 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Updating instance_info_cache with network_info: [{"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Releasing lock "refresh_cache-48c33b8f-cdd5-452e-9c39-3e5504db6b1f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'flavor' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-3adff2d0-23b1-4818-8ef4-636e49cf9e32 req-3f08125e-c7f7-4dc6-b590-f47ff1a86185 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3adff2d0-23b1-4818-8ef4-636e49cf9e32 req-3f08125e-c7f7-4dc6-b590-f47ff1a86185 service nova] Acquiring lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3adff2d0-23b1-4818-8ef4-636e49cf9e32 req-3f08125e-c7f7-4dc6-b590-f47ff1a86185 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3adff2d0-23b1-4818-8ef4-636e49cf9e32 req-3f08125e-c7f7-4dc6-b590-f47ff1a86185 service nova] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-3adff2d0-23b1-4818-8ef4-636e49cf9e32 req-3f08125e-c7f7-4dc6-b590-f47ff1a86185 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] No waiting events found dispatching network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:14 user nova-compute[75216]: WARNING nova.compute.manager [req-3adff2d0-23b1-4818-8ef4-636e49cf9e32 req-3f08125e-c7f7-4dc6-b590-f47ff1a86185 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received unexpected event network-vif-plugged-a399f62c-e5e9-46bd-afae-7261a28b46b3 for instance with vm_state active and task_state deleting.
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-3adff2d0-23b1-4818-8ef4-636e49cf9e32 req-3f08125e-c7f7-4dc6-b590-f47ff1a86185 service nova] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Received event network-vif-deleted-a399f62c-e5e9-46bd-afae-7261a28b46b3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:14 user nova-compute[75216]: INFO nova.compute.manager [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Took 0.99 seconds to detach 1 volumes for instance.
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] [instance: bf29e71d-bdea-49a2-9640-5fb7bc9ff72f] Deleting volume: 2d01113d-db63-44c0-95df-346152c151ac {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:59:14 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:59:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance destroyed successfully.
Nov 02 04:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:14 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Deleted allocations for instance bf29e71d-bdea-49a2-9640-5fb7bc9ff72f
Nov 02 04:59:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7b1eff37-2c83-48d6-a633-843ea5e95afb tempest-TestShelveInstance-1358632032 tempest-TestShelveInstance-1358632032-project-member] Lock "bf29e71d-bdea-49a2-9640-5fb7bc9ff72f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.594s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:16 user nova-compute[75216]: WARNING nova.compute.manager [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:59:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:16 user nova-compute[75216]: WARNING nova.compute.manager [req-988e50f3-e28e-46cd-a699-b695b9663cda req-c65e8696-501b-4311-8b1e-443b04bb4ee6 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:59:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:18 user nova-compute[75216]: WARNING nova.compute.manager [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:59:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:18 user nova-compute[75216]: WARNING nova.compute.manager [req-03ae0501-d32d-4b8e-8f6b-87227a94240a req-9ee7bd95-151d-4c32-8f0b-988c6132b07b service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state rescued and task_state unrescuing.
Nov 02 04:59:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c5493aef-ab83-44a4-a258-856fa8b9c71e tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 04:59:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:59:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:59:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7562MB free_disk=24.91622543334961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9d70d083-152e-41b7-ac2f-bf525b92593b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 48c33b8f-cdd5-452e-9c39-3e5504db6b1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4da30dfe-3083-4e6c-a3bf-a85eb11d48de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance af65cc0f-3880-4df7-8c62-61efbcc110fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 04:59:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.923s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 04:59:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Updating instance_info_cache with network_info: [{"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-ec15f413-2cb5-4dec-b2c5-1620b52caf7c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:59:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 04:59:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNoLKpkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:59:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:59:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:59:35 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a2525-3234-4a9e-ae2e-430d6ad50592]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 04:59:35 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfa0927-3467-402d-98e5-95cbf21eca7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191] added
Nov 02 04:59:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af882264-32e3-47f8-a1b5-fce78716a62c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea227621-d6c0-491c-add0-5ba3bc0c85d6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNoLKpkg {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNoLKpkg" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a91862-7af6-4e94-b6fc-61f2ebf427c7]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNoLKpkg'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f172c8-efd9-462b-80a8-820d53604b21]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a44f82-5f1e-46b8-8943-db36ed72cf1c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f72f765-ddcb-418e-b90e-2d448b006cd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260]
Nov 02 04:59:35 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260] successful.
Nov 02 04:59:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb410d2d-0c71-42f3-800c-61f2dc32a845]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddb90d9-2562-44bd-bfee-ab96abf826bd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:35 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff4b07-41bc-42f3-9f5b-0f7b9ef0cffa]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 04:59:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNoLKpkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 04:59:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:59:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23632663733343135', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:59:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632663733343135', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 04:59:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lazy-loading 'flavor' on Instance uuid 838dfbb6-38e1-40b0-8c70-31ce4953e285 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:59:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 04:59:36 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:59:36 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 02 04:59:36 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:59:36 user nova-compute[75216]:   <serial>059b5336-b4b4-4608-a03f-8c7267d57191</serial>
Nov 02 04:59:36 user nova-compute[75216]: </disk>
Nov 02 04:59:36 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 04:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 04:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] No VIF found with MAC fa:16:3e:01:53:0c, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 04:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41a6d84-771a-4184-bdf7-d01fa8db37ea tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.266s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:39 user nova-compute[75216]: INFO nova.compute.manager [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Detaching volume 059b5336-b4b4-4608-a03f-8c7267d57191
Nov 02 04:59:40 user nova-compute[75216]: INFO nova.virt.block_device [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Attempting to driver detach volume 059b5336-b4b4-4608-a03f-8c7267d57191 from mountpoint /dev/vdb
Nov 02 04:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Attempting to detach device vdb from instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:59:40 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:59:40 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 02 04:59:40 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:59:40 user nova-compute[75216]:   <serial>059b5336-b4b4-4608-a03f-8c7267d57191</serial>
Nov 02 04:59:40 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:59:40 user nova-compute[75216]: </disk>
Nov 02 04:59:40 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:59:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Successfully detached device vdb from instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 from the persistent domain config.
Nov 02 04:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:59:40 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:59:40 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 02 04:59:40 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:59:40 user nova-compute[75216]:   <serial>059b5336-b4b4-4608-a03f-8c7267d57191</serial>
Nov 02 04:59:40 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 04:59:40 user nova-compute[75216]: </disk>
Nov 02 04:59:40 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:59:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-changed-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing instance network info cache due to event network-changed-61b6718e-9c4b-462c-af56-b2117e8b8662. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:59:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] Acquiring lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:59:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] Acquired lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:59:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Refreshing network info cache for port 61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:59:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updated VIF entry in instance network info cache for port 61b6718e-9c4b-462c-af56-b2117e8b8662. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:59:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [{"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6b4022df-f5da-4cd3-8c0b-2bb2585d9982 req-56f461d2-737a-4fa5-9569-782afb540ee1 service nova] Releasing lock "refresh_cache-4da30dfe-3083-4e6c-a3bf-a85eb11d48de" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:59:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:45 user nova-compute[75216]: INFO nova.compute.manager [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Terminating instance
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a60ba19d-3e9a-473c-86f6-0d5b12eeaeef req-abc53dbb-78cd-4cdf-8c3a-efb39bd3e97a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a60ba19d-3e9a-473c-86f6-0d5b12eeaeef req-abc53dbb-78cd-4cdf-8c3a-efb39bd3e97a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a60ba19d-3e9a-473c-86f6-0d5b12eeaeef req-abc53dbb-78cd-4cdf-8c3a-efb39bd3e97a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a60ba19d-3e9a-473c-86f6-0d5b12eeaeef req-abc53dbb-78cd-4cdf-8c3a-efb39bd3e97a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a60ba19d-3e9a-473c-86f6-0d5b12eeaeef req-abc53dbb-78cd-4cdf-8c3a-efb39bd3e97a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-unplugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a60ba19d-3e9a-473c-86f6-0d5b12eeaeef req-abc53dbb-78cd-4cdf-8c3a-efb39bd3e97a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-61b6718e-9c4b-462c-af56-b2117e8b8662 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e8db332-b35d-4376-be30-385b131a18ed req-9c70551c-9534-43db-a90a-9ff47de7c343 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e8db332-b35d-4376-be30-385b131a18ed req-9c70551c-9534-43db-a90a-9ff47de7c343 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e8db332-b35d-4376-be30-385b131a18ed req-9c70551c-9534-43db-a90a-9ff47de7c343 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e8db332-b35d-4376-be30-385b131a18ed req-9c70551c-9534-43db-a90a-9ff47de7c343 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e8db332-b35d-4376-be30-385b131a18ed req-9c70551c-9534-43db-a90a-9ff47de7c343 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-unplugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e8db332-b35d-4376-be30-385b131a18ed req-9c70551c-9534-43db-a90a-9ff47de7c343 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-7ae6b9eb-01ea-427b-a2a2-733a6850e3b6 req-21a2b588-81d5-42a3-991d-fa7a3626816a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7ae6b9eb-01ea-427b-a2a2-733a6850e3b6 req-21a2b588-81d5-42a3-991d-fa7a3626816a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7ae6b9eb-01ea-427b-a2a2-733a6850e3b6 req-21a2b588-81d5-42a3-991d-fa7a3626816a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7ae6b9eb-01ea-427b-a2a2-733a6850e3b6 req-21a2b588-81d5-42a3-991d-fa7a3626816a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-7ae6b9eb-01ea-427b-a2a2-733a6850e3b6 req-21a2b588-81d5-42a3-991d-fa7a3626816a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-unplugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-7ae6b9eb-01ea-427b-a2a2-733a6850e3b6 req-21a2b588-81d5-42a3-991d-fa7a3626816a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Instance destroyed successfully.
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lazy-loading 'resources' on Instance uuid 4da30dfe-3083-4e6c-a3bf-a85eb11d48de {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "61b6718e-9c4b-462c-af56-b2117e8b8662", "address": "fa:16:3e:c9:2c:1d", "network": {"id": "cfa1a434-8af7-4ea3-a359-6c57d17bf5e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583009960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61b6718e-9c", "ovs_interfaceid": "61b6718e-9c4b-462c-af56-b2117e8b8662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:2c:1d,bridge_name='br-int',has_traffic_filtering=True,id=61b6718e-9c4b-462c-af56-b2117e8b8662,network=Network(cfa1a434-8af7-4ea3-a359-6c57d17bf5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61b6718e-9c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:2c:1d,bridge_name='br-int',has_traffic_filtering=True,id=61b6718e-9c4b-462c-af56-b2117e8b8662,network=Network(cfa1a434-8af7-4ea3-a359-6c57d17bf5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61b6718e-9c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61b6718e-9c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7f1f9e1-5183-4651-b2b2-1ca249abce7b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:2c:1d,bridge_name='br-int',has_traffic_filtering=True,id=61b6718e-9c4b-462c-af56-b2117e8b8662,network=Network(cfa1a434-8af7-4ea3-a359-6c57d17bf5e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61b6718e-9c')
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:72:31,bridge_name='br-int',has_traffic_filtering=True,id=c4e822fa-4b56-4530-b90a-7d867c7b8ed8,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc4e822fa-4b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:72:31,bridge_name='br-int',has_traffic_filtering=True,id=c4e822fa-4b56-4530-b90a-7d867c7b8ed8,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc4e822fa-4b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4e822fa-4b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b467b14-5a1b-4ef3-9903-c92912dbe7ce) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:72:31,bridge_name='br-int',has_traffic_filtering=True,id=c4e822fa-4b56-4530-b90a-7d867c7b8ed8,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc4e822fa-4b')
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=393a501b-cb81-4fe3-83fe-7f2bf2da0be5,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap393a501b-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=393a501b-cb81-4fe3-83fe-7f2bf2da0be5,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap393a501b-cb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap393a501b-cb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51dd1802-7999-430b-b017-6c1b798cecc5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=393a501b-cb81-4fe3-83fe-7f2bf2da0be5,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap393a501b-cb')
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a94ae3f0-817a-4943-ad82-a7efa70d15b6,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94ae3f0-81') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a94ae3f0-817a-4943-ad82-a7efa70d15b6,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94ae3f0-81') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa94ae3f0-81, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a5239ab-48c0-47b6-ae23-988f420523e1) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a94ae3f0-817a-4943-ad82-a7efa70d15b6,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94ae3f0-81')
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:3b:02,bridge_name='br-int',has_traffic_filtering=True,id=849bcaec-1bf2-4b87-9b70-7e728cec0154,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap849bcaec-1b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:3b:02,bridge_name='br-int',has_traffic_filtering=True,id=849bcaec-1bf2-4b87-9b70-7e728cec0154,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap849bcaec-1b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap849bcaec-1b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab752aab-2352-4bd8-855b-9a2d6cc31cdd) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:3b:02,bridge_name='br-int',has_traffic_filtering=True,id=849bcaec-1bf2-4b87-9b70-7e728cec0154,network=Network(7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap849bcaec-1b')
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:29,bridge_name='br-int',has_traffic_filtering=True,id=fbb09594-5665-4640-abe0-c1d499c48230,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb09594-56') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:29,bridge_name='br-int',has_traffic_filtering=True,id=fbb09594-5665-4640-abe0-c1d499c48230,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb09594-56') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbb09594-56, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89ef26b1-23f7-4c90-917c-3e7fbcc806ba) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:29,bridge_name='br-int',has_traffic_filtering=True,id=fbb09594-5665-4640-abe0-c1d499c48230,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb09594-56')
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T04:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1776230610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1776230610',id=30,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJig+qpaQNCqYPwTjm8umIFmAH18Ixo+rN8w9ApISr+7jcbEPn7gxx/aeVXS+lE/WViVzIlxtOuFF8Z6VSQ+0eza5daZuUrj4merBcymJqjHNeXinIR47wAlOfh0smtxA==',key_name='tempest-keypair-1025821146',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c94946efcb3b4b49967b47d62446269c',ramdisk_id='',reservation_id='r-81khffwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-719347030',owner_user_name='tempest-TaggedBootDevicesTest_v242-719347030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0647ffce9f894d59ac9bd8509c79393b',uuid=4da30dfe-3083-4e6c-a3bf-a85eb11d48de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converting VIF {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3a:fe,bridge_name='br-int',has_traffic_filtering=True,id=18f60d6e-e06b-4c32-81e9-6a027fb7d909,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f60d6e-e0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3a:fe,bridge_name='br-int',has_traffic_filtering=True,id=18f60d6e-e06b-4c32-81e9-6a027fb7d909,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f60d6e-e0') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18f60d6e-e0, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34f736fe-6595-41b5-bc1c-c4ce975e57bd) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:47 user nova-compute[75216]: INFO os_vif [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3a:fe,bridge_name='br-int',has_traffic_filtering=True,id=18f60d6e-e06b-4c32-81e9-6a027fb7d909,network=Network(62eded7f-1796-482f-a221-86e6321eb6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f60d6e-e0')
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKOhdzrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:59:47 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1266a-6a9d-4b65-8089-8894b49ce95e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:59:47 user nova-compute[75216]: No targets found.
Nov 02 04:59:47 user nova-compute[75216]: iSNS:
Nov 02 04:59:47 user nova-compute[75216]: No targets found.
Nov 02 04:59:47 user nova-compute[75216]: STATIC:
Nov 02 04:59:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:59:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a
Nov 02 04:59:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce
Nov 02 04:59:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf
Nov 02 04:59:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:59:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191
Nov 02 04:59:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:59:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:47 user nova-compute[75216]: FIRMWARE:
Nov 02 04:59:47 user nova-compute[75216]: No targets found.
Nov 02 04:59:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:59:47 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:59:47 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c594562-0386-45cb-bb45-e4926e0cf272]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0f8310-5dcf-4e32-8311-adf3e5eed391]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:47 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460c1b6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6b8ce7-cd67-4c95-862b-67f29e4124af]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-a51cba16-71a8-4737-bc3f-3ffb83fb054d req-935c6f45-b1c9-431a-9ab5-ab47c796a5c8 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51cba16-71a8-4737-bc3f-3ffb83fb054d req-935c6f45-b1c9-431a-9ab5-ab47c796a5c8 service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51cba16-71a8-4737-bc3f-3ffb83fb054d req-935c6f45-b1c9-431a-9ab5-ab47c796a5c8 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51cba16-71a8-4737-bc3f-3ffb83fb054d req-935c6f45-b1c9-431a-9ab5-ab47c796a5c8 service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-a51cba16-71a8-4737-bc3f-3ffb83fb054d req-935c6f45-b1c9-431a-9ab5-ab47c796a5c8 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:47 user nova-compute[75216]: WARNING nova.compute.manager [req-a51cba16-71a8-4737-bc3f-3ffb83fb054d req-935c6f45-b1c9-431a-9ab5-ab47c796a5c8 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-61b6718e-9c4b-462c-af56-b2117e8b8662 for instance with vm_state active and task_state deleting.
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbe884e-d5a3-4553-a347-6920f1a41b1b]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c5cc49-7ac5-4789-94c3-ee283691d208]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c355baa-ea01-4f92-a34e-9cb1beb91ea6]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ae8db-e4d9-48ab-a941-61595481ec8f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:47 user nova-compute[75216]: WARNING nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-393a501b-cb81-4fe3-83fe-7f2bf2da0be5 for instance with vm_state active and task_state deleting.
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-unplugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:47 user nova-compute[75216]: WARNING nova.compute.manager [req-1ba12707-eb8f-4d9e-bd41-c64de5a0b377 req-c4da03ee-ffb3-451a-80dd-ad640e56b59c service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-849bcaec-1bf2-4b87-9b70-7e728cec0154 for instance with vm_state active and task_state deleting.
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8794b234-481c-4ee8-9afe-af0d482e22b6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260]
Nov 02 04:59:47 user nova-compute[75216]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a, portal: 172.16.0.220,3260] successful.
Nov 02 04:59:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:48 user nova-compute[75216]: WARNING nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-c4e822fa-4b56-4530-b90a-7d867c7b8ed8 for instance with vm_state active and task_state deleting.
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-unplugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:48 user nova-compute[75216]: WARNING nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-a94ae3f0-817a-4943-ad82-a7efa70d15b6 for instance with vm_state active and task_state deleting.
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-unplugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-fbb09594-5665-4640-abe0-c1d499c48230 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:48 user nova-compute[75216]: WARNING nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-fbb09594-5665-4640-abe0-c1d499c48230 for instance with vm_state active and task_state deleting.
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-unplugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-unplugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] No waiting events found dispatching network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 04:59:48 user nova-compute[75216]: WARNING nova.compute.manager [req-a88988b1-c1cc-4957-a262-7a54d63da2a4 req-5b52aef3-60a6-463d-b519-c1d0d073854a service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received unexpected event network-vif-plugged-18f60d6e-e06b-4c32-81e9-6a027fb7d909 for instance with vm_state active and task_state deleting.
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e0ecc7-7922-425d-b28c-e95ff1eae48a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84739d86-13d2-4453-998a-c44aa6650f97]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== disconnect_volume: return (359ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLajxEZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:59:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd579b4-599d-441e-b4ab-fda557b2100d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:59:48 user nova-compute[75216]: No targets found.
Nov 02 04:59:48 user nova-compute[75216]: iSNS:
Nov 02 04:59:48 user nova-compute[75216]: No targets found.
Nov 02 04:59:48 user nova-compute[75216]: STATIC:
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: FIRMWARE:
Nov 02 04:59:48 user nova-compute[75216]: No targets found.
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:59:48 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:59:48 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b86c9-1988-4da6-9181-51da5e85d6ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3744a54b-aa67-4522-8f64-feecb89004b8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec436a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce'): ({'sdi'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Removing single pathed devices sdi {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a773560e-9d65-4d92-ae1d-6a8d5ae25c8d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a5b335-c8fb-4f66-8fd4-e43e6131c6e5]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Flushing IO for device /dev/sdi {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[695b0903-0a0c-480f-a796-198892b4aa8e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.036s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a96e9-a9dd-448d-a0e6-d493f085613b]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b2bc08-28ac-4dde-ae66-9576aa2bda0f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b6182-5b2e-4708-b5cb-b965f50f648c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260]
Nov 02 04:59:48 user nova-compute[75216]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce, portal: 172.16.0.220,3260] successful.
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93672707-7936-4c52-9f52-4eef05b3e8ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bffbba-2221-4634-a11e-21d06552de14]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== disconnect_volume: return (320ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deoksDuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:59:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9662d869-ddd0-4be5-9e82-438b9cf32605]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 04:59:48 user nova-compute[75216]: No targets found.
Nov 02 04:59:48 user nova-compute[75216]: iSNS:
Nov 02 04:59:48 user nova-compute[75216]: No targets found.
Nov 02 04:59:48 user nova-compute[75216]: STATIC:
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 04:59:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 04:59:48 user nova-compute[75216]:                 Iface Name: default
Nov 02 04:59:48 user nova-compute[75216]: FIRMWARE:
Nov 02 04:59:48 user nova-compute[75216]: No targets found.
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 04:59:48 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 04:59:48 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3540ba-0af0-4e8a-bd41-fb120be16209]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d0be2f-d272-4fdc-917f-3209814f423f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf (non-flash)
Nov 02 04:59:48 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec436a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf'): ({'sdh'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Removing single pathed devices sdh {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac90cb8-f98d-4121-8398-3ca8da6c1ef7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b58c2-3c6c-4e3c-a2da-d6d682a94f62]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Flushing IO for device /dev/sdh {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e560c17-5f80-4675-9d89-86587ee89577]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365a415-b429-4c72-9731-837c9b20b17a]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] SCSI volumes sdh have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce51ba0-a3b7-4dd1-b196-91258cd7deee]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b15194-54dc-4b4f-a4c1-78863ee41c1a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260]
Nov 02 04:59:48 user nova-compute[75216]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf, portal: 172.16.0.220,3260] successful.
Nov 02 04:59:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9653497-568d-4be0-b250-516eac053abf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdab81d0-4961-46e8-bc3c-a60c840e141a]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] <== disconnect_volume: return (341ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 04:59:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Deleting instance files /opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de_del
Nov 02 04:59:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Deletion of /opt/stack/data/nova/instances/4da30dfe-3083-4e6c-a3bf-a85eb11d48de_del complete
Nov 02 04:59:48 user nova-compute[75216]: INFO nova.compute.manager [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Took 3.57 seconds to destroy the instance on the hypervisor.
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:48 user nova-compute[75216]: INFO nova.compute.manager [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Detaching volume 5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 04:59:48 user nova-compute[75216]: INFO nova.virt.block_device [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Attempting to driver detach volume 5a6f2bf0-953c-4d34-9cbc-c9ef15802626 from mountpoint /dev/vdb
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Attempting to detach device vdb from instance 9d70d083-152e-41b7-ac2f-bf525b92593b from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:59:48 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:59:48 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:59:48 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:59:48 user nova-compute[75216]:   <serial>5a6f2bf0-953c-4d34-9cbc-c9ef15802626</serial>
Nov 02 04:59:48 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 04:59:48 user nova-compute[75216]: </disk>
Nov 02 04:59:48 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:59:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully detached device vdb from instance 9d70d083-152e-41b7-ac2f-bf525b92593b from the persistent domain config.
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d70d083-152e-41b7-ac2f-bf525b92593b from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 04:59:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 04:59:48 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 04:59:48 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 04:59:48 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 04:59:48 user nova-compute[75216]:   <serial>5a6f2bf0-953c-4d34-9cbc-c9ef15802626</serial>
Nov 02 04:59:48 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 04:59:48 user nova-compute[75216]: </disk>
Nov 02 04:59:48 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 04:59:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 04:59:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-changed-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Refreshing instance network info cache due to event network-changed-a7ccfecd-5875-4e4f-9780-15250fd24876. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 04:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] Acquiring lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 04:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] Acquired lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 04:59:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Refreshing network info cache for port a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 04:59:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-bbccd0ab-99f5-477f-b3bd-61cae71f1d63 req-f84bf229-3de0-4433-a20d-7e0ee3199173 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-deleted-61b6718e-9c4b-462c-af56-b2117e8b8662 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:50 user nova-compute[75216]: INFO nova.compute.manager [req-bbccd0ab-99f5-477f-b3bd-61cae71f1d63 req-f84bf229-3de0-4433-a20d-7e0ee3199173 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Neutron deleted interface 61b6718e-9c4b-462c-af56-b2117e8b8662; detaching it from the instance and deleting it from the info cache
Nov 02 04:59:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-bbccd0ab-99f5-477f-b3bd-61cae71f1d63 req-f84bf229-3de0-4433-a20d-7e0ee3199173 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [{"id": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "address": "fa:16:3e:90:72:31", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e822fa-4b", "ovs_interfaceid": "c4e822fa-4b56-4530-b90a-7d867c7b8ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "address": "fa:16:3e:d4:0d:d3", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393a501b-cb", "ovs_interfaceid": "393a501b-cb81-4fe3-83fe-7f2bf2da0be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "address": "fa:16:3e:1c:8d:fb", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94ae3f0-81", "ovs_interfaceid": "a94ae3f0-817a-4943-ad82-a7efa70d15b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "address": "fa:16:3e:50:3b:02", "network": {"id": "7871f7b3-4088-4fd2-a3ad-f4c3b5d5c59a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1764595771", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap849bcaec-1b", "ovs_interfaceid": "849bcaec-1bf2-4b87-9b70-7e728cec0154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fbb09594-5665-4640-abe0-c1d499c48230", "address": "fa:16:3e:90:ea:29", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb09594-56", "ovs_interfaceid": "fbb09594-5665-4640-abe0-c1d499c48230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "address": "fa:16:3e:0e:3a:fe", "network": {"id": "62eded7f-1796-482f-a221-86e6321eb6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1230653343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c94946efcb3b4b49967b47d62446269c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f60d6e-e0", "ovs_interfaceid": "18f60d6e-e06b-4c32-81e9-6a027fb7d909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-bbccd0ab-99f5-477f-b3bd-61cae71f1d63 req-f84bf229-3de0-4433-a20d-7e0ee3199173 service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Detach interface failed, port_id=61b6718e-9c4b-462c-af56-b2117e8b8662, reason: Instance 4da30dfe-3083-4e6c-a3bf-a85eb11d48de could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'flavor' on Instance uuid af65cc0f-3880-4df7-8c62-61efbcc110fa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 04:59:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Ignoring supplied device name: /dev/vdb
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: INFO nova.compute.manager [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Attaching volume e77cbcce-5799-4157-8c6c-1d7d031defde to /dev/vdb
Nov 02 04:59:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Updated VIF entry in instance network info cache for port a7ccfecd-5875-4e4f-9780-15250fd24876. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Updating instance_info_cache with network_info: [{"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6ace41-b181-448a-b1d7-54d7d725938b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b52b000d-e2d7-4104-9cd3-4948403107de req-48fb776d-b83a-4b40-b201-075c86daad60 service nova] Releasing lock "refresh_cache-af65cc0f-3880-4df7-8c62-61efbcc110fa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1c8413-a643-4811-a7ac-efd0ccad5479]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7197f612-9a6e-4f28-9b11-e85f7a8866ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe5474-35f1-49bb-9e63-08419ec21136]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 04:59:51 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0926e4-f781-4dde-92e4-4af1ab9ea377]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Updating existing volume attachment record: 3572b4c0-e625-4308-b683-4bf90ddfd7e1 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 04:59:51 user nova-compute[75216]: WARNING nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 3b055742-c605-41ab-bd40-1a777b8f4e39 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid e99b36cc-571e-46d6-9a30-7aa3a0801ffd {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid ec15f413-2cb5-4dec-b2c5-1620b52caf7c {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid b2016901-3f50-4de3-8eb1-ffa4c67e2b78 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 838dfbb6-38e1-40b0-8c70-31ce4953e285 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid af65cc0f-3880-4df7-8c62-61efbcc110fa {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 4da30dfe-3083-4e6c-a3bf-a85eb11d48de {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "43182725-9f83-4afd-a243-49d838e7d811" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "43182725-9f83-4afd-a243-49d838e7d811" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:52 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 04:59:52 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Took 3.63 seconds to deallocate network for instance.
Nov 02 04:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-f21b3ad0-7a93-42ad-b78f-a3ba7471829d req-a15e38c3-6b39-45b3-ac25-2e0312620dea service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-deleted-18f60d6e-e06b-4c32-81e9-6a027fb7d909 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-f21b3ad0-7a93-42ad-b78f-a3ba7471829d req-a15e38c3-6b39-45b3-ac25-2e0312620dea service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-deleted-849bcaec-1bf2-4b87-9b70-7e728cec0154 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-f21b3ad0-7a93-42ad-b78f-a3ba7471829d req-a15e38c3-6b39-45b3-ac25-2e0312620dea service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-deleted-a94ae3f0-817a-4943-ad82-a7efa70d15b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-f21b3ad0-7a93-42ad-b78f-a3ba7471829d req-a15e38c3-6b39-45b3-ac25-2e0312620dea service nova] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Received event network-vif-deleted-fbb09594-5665-4640-abe0-c1d499c48230 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 04:59:55 user nova-compute[75216]: INFO nova.compute.manager [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] Took 3.27 seconds to detach 3 volumes for instance.
Nov 02 04:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 04:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:56 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 04:59:56 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 04:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:56 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Deleted allocations for instance 4da30dfe-3083-4e6c-a3bf-a85eb11d48de
Nov 02 04:59:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 04:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e635d5df-e6f5-4e77-b70d-82f61951f7dc tempest-TaggedBootDevicesTest_v242-719347030 tempest-TaggedBootDevicesTest_v242-719347030-project-member] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.045s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.576s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 04:59:56 user nova-compute[75216]: INFO nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 4da30dfe-3083-4e6c-a3bf-a85eb11d48de] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 02 04:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "4da30dfe-3083-4e6c-a3bf-a85eb11d48de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 04:59:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 is timed out.
Nov 02 05:00:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Successfully detached device vdb from instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 from the live domain config.
Nov 02 05:00:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNoLKpkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:00:00 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[717bbd83-a3d9-4d83-8085-a8a93176a170]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:00:00 user nova-compute[75216]: No targets found.
Nov 02 05:00:00 user nova-compute[75216]: iSNS:
Nov 02 05:00:00 user nova-compute[75216]: No targets found.
Nov 02 05:00:00 user nova-compute[75216]: STATIC:
Nov 02 05:00:00 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 05:00:00 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:00:00 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:00:00 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 05:00:00 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:00:00 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:00:00 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191
Nov 02 05:00:00 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:00:00 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:00:00 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 05:00:00 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:00:00 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:00:00 user nova-compute[75216]: FIRMWARE:
Nov 02 05:00:00 user nova-compute[75216]: No targets found.
Nov 02 05:00:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:00:00 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:00:00 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e16a085-21ed-4985-b940-d78853cb7187]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4ead38-0966-44f3-8fec-d7667640e196]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 (non-flash)
Nov 02 05:00:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5d5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc9987-5e79-41a4-b11f-34502bc27cbb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3079c40-b006-4e46-aeaf-b5d1d950c041]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60899ff-0399-4675-b668-d34105e280cd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a74cc-d6de-477e-8e90-a0ed3cb8a04d]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1c13b5-557b-4189-b967-500f3beba7d8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[794cc513-cab0-4837-b8ec-59efd8fde814]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260]
Nov 02 05:00:00 user nova-compute[75216]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191, portal: 172.16.0.220,3260] successful.
Nov 02 05:00:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:059b5336-b4b4-4608-a03f-8c7267d57191 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e10e02-06c2-41ad-af80-ef704c8b6691]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] <== disconnect_volume: return (362ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:00:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:00:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:03 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lazy-loading 'flavor' on Instance uuid 838dfbb6-38e1-40b0-8c70-31ce4953e285 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:00:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c31c3f7b-44e8-407a-9c1a-aa45cb2848f6 tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.860s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.097s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9d70d083-152e-41b7-ac2f-bf525b92593b is timed out.
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully detached device vdb from instance 9d70d083-152e-41b7-ac2f-bf525b92593b from the live domain config.
Nov 02 05:00:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwWoeamZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:00:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9277f8f-002c-4733-8561-ad42e8d50d5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:00:09 user nova-compute[75216]: No targets found.
Nov 02 05:00:09 user nova-compute[75216]: iSNS:
Nov 02 05:00:09 user nova-compute[75216]: No targets found.
Nov 02 05:00:09 user nova-compute[75216]: STATIC:
Nov 02 05:00:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 05:00:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:00:09 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:00:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626
Nov 02 05:00:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:00:09 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:00:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 05:00:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:00:09 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:00:09 user nova-compute[75216]: FIRMWARE:
Nov 02 05:00:09 user nova-compute[75216]: No targets found.
Nov 02 05:00:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:00:09 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:00:09 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7080bd-e73e-4acc-b152-3d139b79f031]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[017fdc46-84fd-4a8c-8c28-96ca157e5e5e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:00:09 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 05:00:09 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 05:00:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:00:09 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 05:00:09 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 (non-flash)
Nov 02 05:00:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46043a4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b9523d-d42b-4a7e-82cf-c6b8519a06e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afcf253-d1a5-45b6-aad8-628862fb7651]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975ff08-f472-40c6-8375-cdf2f8bd3f9e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1068d-b8b4-49b8-8e42-584b6ccfd897]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[240f48c0-8b92-4784-b1fa-202434a6a904]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4ec06-396b-4ff9-adb6-38341f40bbdc]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260]
Nov 02 05:00:09 user nova-compute[75216]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626, portal: 172.16.0.220,3260] successful.
Nov 02 05:00:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6f2bf0-953c-4d34-9cbc-c9ef15802626 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3358e9de-df21-491f-8319-3638dba8d731]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== disconnect_volume: return (311ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:00:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'flavor' on Instance uuid 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:00:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7e831083-3310-497a-8d05-1d7a1e930946 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.983s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.volume.cinder [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Update attachment failed for attachment 3572b4c0-e625-4308-b683-4bf90ddfd7e1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-416c9b45-55b6-475c-96f3-3c4b6e7a3806) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-416c9b45-55b6-475c-96f3-3c4b6e7a3806)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Failed to attach e77cbcce-5799-4157-8c6c-1d7d031defde at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-416c9b45-55b6-475c-96f3-3c4b6e7a3806)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Traceback (most recent call last):
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     self._do_attach(context, instance, volume, volume_api,
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     self._volume_attach(context, volume, connector, instance,
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     connection_info = volume_api.attachment_update(
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     res = method(self, ctx, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     with excutils.save_and_reraise_exception():
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     self.force_reraise()
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     raise self.value
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     return method.func(obj, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     resp = self._update('/attachments/%s' % id, body)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     return self.request(url, method, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa]     raise exceptions.from_response(resp, body)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-416c9b45-55b6-475c-96f3-3c4b6e7a3806)
Nov 02 05:00:11 user nova-compute[75216]: ERROR nova.compute.manager [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] 
Nov 02 05:00:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.803s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.555s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server [None req-903d8e5f-a63c-493e-a7a9-f5b237a4bee2 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-416c9b45-55b6-475c-96f3-3c4b6e7a3806)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-416c9b45-55b6-475c-96f3-3c4b6e7a3806)
Nov 02 05:00:11 user nova-compute[75216]: ERROR oslo_messaging.rpc.server 
Nov 02 05:00:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:00:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:00:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=24.903549194335938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:00:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9d70d083-152e-41b7-ac2f-bf525b92593b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 48c33b8f-cdd5-452e-9c39-3e5504db6b1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 838dfbb6-38e1-40b0-8c70-31ce4953e285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance af65cc0f-3880-4df7-8c62-61efbcc110fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:00:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:00:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Updating instance_info_cache with network_info: [{"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:00:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-b2016901-3f50-4de3-8eb1-ffa4c67e2b78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:00:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:00:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:00:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:00:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:39 user nova-compute[75216]: INFO nova.compute.manager [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Terminating instance
Nov 02 05:00:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-563d4fa1-6964-4c9a-8106-bde383271aee req-52169b85-bfec-4ae6-bae6-bb72abbce0ee service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-unplugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-563d4fa1-6964-4c9a-8106-bde383271aee req-52169b85-bfec-4ae6-bae6-bb72abbce0ee service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-563d4fa1-6964-4c9a-8106-bde383271aee req-52169b85-bfec-4ae6-bae6-bb72abbce0ee service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-563d4fa1-6964-4c9a-8106-bde383271aee req-52169b85-bfec-4ae6-bae6-bb72abbce0ee service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-563d4fa1-6964-4c9a-8106-bde383271aee req-52169b85-bfec-4ae6-bae6-bb72abbce0ee service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-unplugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:00:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-563d4fa1-6964-4c9a-8106-bde383271aee req-52169b85-bfec-4ae6-bae6-bb72abbce0ee service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-unplugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Instance destroyed successfully.
Nov 02 05:00:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'resources' on Instance uuid 9d70d083-152e-41b7-ac2f-bf525b92593b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T04:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099158629',display_name='tempest-ServerActionsTestOtherA-server-1648751664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099158629',id=26,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFYOuFoTYzs/OpBaoPrRjbFL2HIlbsNUljvKcH0UTQVvhrHvUp7DogNAcmNfCRZ7AXuFaF52hw+nOmVNTAC/hfKnH2b6bWCetY999y4zJb2XjnFwgLG6UqHmPtnOuruxA==',key_name='tempest-keypair-2120961819',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-2saiixwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=9d70d083-152e-41b7-ac2f-bf525b92593b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "address": "fa:16:3e:aa:fa:51", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd4b05f-28", "ovs_interfaceid": "edd4b05f-28d5-4af0-ba62-5f8112fbc767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG os_vif [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd4b05f-28, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0afad53-7bdf-4c57-9b5b-fc0af4a645c4) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:40 user nova-compute[75216]: INFO os_vif [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:fa:51,bridge_name='br-int',has_traffic_filtering=True,id=edd4b05f-28d5-4af0-ba62-5f8112fbc767,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd4b05f-28')
Nov 02 05:00:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Deleting instance files /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b_del
Nov 02 05:00:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Deletion of /opt/stack/data/nova/instances/9d70d083-152e-41b7-ac2f-bf525b92593b_del complete
Nov 02 05:00:40 user nova-compute[75216]: INFO nova.compute.manager [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 02 05:00:40 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:00:40 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:00:41 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Took 1.00 seconds to deallocate network for instance.
Nov 02 05:00:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-70e379a1-0051-4c27-8606-0d279e468507 req-6edf41b7-816c-4e16-b028-a7ab59494aff service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70e379a1-0051-4c27-8606-0d279e468507 req-6edf41b7-816c-4e16-b028-a7ab59494aff service nova] Acquiring lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70e379a1-0051-4c27-8606-0d279e468507 req-6edf41b7-816c-4e16-b028-a7ab59494aff service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70e379a1-0051-4c27-8606-0d279e468507 req-6edf41b7-816c-4e16-b028-a7ab59494aff service nova] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-70e379a1-0051-4c27-8606-0d279e468507 req-6edf41b7-816c-4e16-b028-a7ab59494aff service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] No waiting events found dispatching network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:00:41 user nova-compute[75216]: WARNING nova.compute.manager [req-70e379a1-0051-4c27-8606-0d279e468507 req-6edf41b7-816c-4e16-b028-a7ab59494aff service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received unexpected event network-vif-plugged-edd4b05f-28d5-4af0-ba62-5f8112fbc767 for instance with vm_state deleted and task_state None.
Nov 02 05:00:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-70e379a1-0051-4c27-8606-0d279e468507 req-6edf41b7-816c-4e16-b028-a7ab59494aff service nova] [instance: 9d70d083-152e-41b7-ac2f-bf525b92593b] Received event network-vif-deleted-edd4b05f-28d5-4af0-ba62-5f8112fbc767 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:41 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Deleted allocations for instance 9d70d083-152e-41b7-ac2f-bf525b92593b
Nov 02 05:00:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1018366-1d59-492c-aeee-e1ab56efdaae tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "9d70d083-152e-41b7-ac2f-bf525b92593b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.680s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:43 user nova-compute[75216]: INFO nova.compute.manager [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Terminating instance
Nov 02 05:00:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-adebb653-812c-4b0d-97cd-fc462e7c619f req-4f2add29-aef5-4bf3-9dd1-c321ad6437f2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-vif-unplugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-adebb653-812c-4b0d-97cd-fc462e7c619f req-4f2add29-aef5-4bf3-9dd1-c321ad6437f2 service nova] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-adebb653-812c-4b0d-97cd-fc462e7c619f req-4f2add29-aef5-4bf3-9dd1-c321ad6437f2 service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-adebb653-812c-4b0d-97cd-fc462e7c619f req-4f2add29-aef5-4bf3-9dd1-c321ad6437f2 service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-adebb653-812c-4b0d-97cd-fc462e7c619f req-4f2add29-aef5-4bf3-9dd1-c321ad6437f2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] No waiting events found dispatching network-vif-unplugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-adebb653-812c-4b0d-97cd-fc462e7c619f req-4f2add29-aef5-4bf3-9dd1-c321ad6437f2 service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-vif-unplugged-ed2f7db0-4989-4640-96c5-b651054973f7 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:00:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Instance destroyed successfully.
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lazy-loading 'resources' on Instance uuid 838dfbb6-38e1-40b0-8c70-31ce4953e285 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-844889376',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-844889376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8448893',id=29,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEdfM/wSubA6Ve8/9bgwY4q7WkGY0sfMrMT4uICzZ/wSVQI8Tdw5SFRDcPT7gs9angeRaeQjAek5FrrofEtcLrk+WaV3i6fx4XS+SHILyLMsR8zaJC8XMUIlLU7oclOnA==',key_name='tempest-keypair-1132889921',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:57:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf742c02eeb2451e85993430c7d36267',ramdisk_id='',reservation_id='r-alvldvx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-902550122',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bf03434f876400e97a796e0eece6587',uuid=838dfbb6-38e1-40b0-8c70-31ce4953e285,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Converting VIF {"id": "ed2f7db0-4989-4640-96c5-b651054973f7", "address": "fa:16:3e:01:53:0c", "network": {"id": "bb6eb2a8-45e0-4ed2-bcca-414a49330bc3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1194183348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf742c02eeb2451e85993430c7d36267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped2f7db0-49", "ovs_interfaceid": "ed2f7db0-4989-4640-96c5-b651054973f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:53:0c,bridge_name='br-int',has_traffic_filtering=True,id=ed2f7db0-4989-4640-96c5-b651054973f7,network=Network(bb6eb2a8-45e0-4ed2-bcca-414a49330bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2f7db0-49') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG os_vif [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:53:0c,bridge_name='br-int',has_traffic_filtering=True,id=ed2f7db0-4989-4640-96c5-b651054973f7,network=Network(bb6eb2a8-45e0-4ed2-bcca-414a49330bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2f7db0-49') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped2f7db0-49, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a49fd79-4c1c-4e30-b32f-51c4a2062434) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:00:44 user nova-compute[75216]: INFO os_vif [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:53:0c,bridge_name='br-int',has_traffic_filtering=True,id=ed2f7db0-4989-4640-96c5-b651054973f7,network=Network(bb6eb2a8-45e0-4ed2-bcca-414a49330bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2f7db0-49')
Nov 02 05:00:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Deleting instance files /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285_del
Nov 02 05:00:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Deletion of /opt/stack/data/nova/instances/838dfbb6-38e1-40b0-8c70-31ce4953e285_del complete
Nov 02 05:00:44 user nova-compute[75216]: INFO nova.compute.manager [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 02 05:00:44 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:00:44 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:00:45 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:00:45 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Took 1.09 seconds to deallocate network for instance.
Nov 02 05:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:46 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Deleted allocations for instance 838dfbb6-38e1-40b0-8c70-31ce4953e285
Nov 02 05:00:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6e7bd9d-d0bf-4989-9b58-bbe20fc4018e req-0235b013-536f-4d0e-b8a7-795e3e0aa8bd service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6e7bd9d-d0bf-4989-9b58-bbe20fc4018e req-0235b013-536f-4d0e-b8a7-795e3e0aa8bd service nova] Acquiring lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6e7bd9d-d0bf-4989-9b58-bbe20fc4018e req-0235b013-536f-4d0e-b8a7-795e3e0aa8bd service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6e7bd9d-d0bf-4989-9b58-bbe20fc4018e req-0235b013-536f-4d0e-b8a7-795e3e0aa8bd service nova] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6e7bd9d-d0bf-4989-9b58-bbe20fc4018e req-0235b013-536f-4d0e-b8a7-795e3e0aa8bd service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] No waiting events found dispatching network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:00:46 user nova-compute[75216]: WARNING nova.compute.manager [req-e6e7bd9d-d0bf-4989-9b58-bbe20fc4018e req-0235b013-536f-4d0e-b8a7-795e3e0aa8bd service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received unexpected event network-vif-plugged-ed2f7db0-4989-4640-96c5-b651054973f7 for instance with vm_state deleted and task_state None.
Nov 02 05:00:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6e7bd9d-d0bf-4989-9b58-bbe20fc4018e req-0235b013-536f-4d0e-b8a7-795e3e0aa8bd service nova] [instance: 838dfbb6-38e1-40b0-8c70-31ce4953e285] Received event network-vif-deleted-ed2f7db0-4989-4640-96c5-b651054973f7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-483d39a8-3f65-49e5-9e70-2b9b3fe9e24f tempest-TestServerVolumeAttachScenarioOldVersion-902550122 tempest-TestServerVolumeAttachScenarioOldVersion-902550122-project-member] Lock "838dfbb6-38e1-40b0-8c70-31ce4953e285" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "84b9cc72-7fbe-4667-8111-13c61211e055" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "84b9cc72-7fbe-4667-8111-13c61211e055" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:00:55 user nova-compute[75216]: INFO nova.compute.claims [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Claim successful on node user
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:00:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.policy [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50087f7e3cad4995a7a46903ff0f4a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841f9f9b7f2b4a97a646419799d76f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:00:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Creating image(s)
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "/opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "/opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "/opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Successfully created port: 7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Cannot resize image /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Ensure instance console log exists: /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Successfully updated port: 7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "refresh_cache-84b9cc72-7fbe-4667-8111-13c61211e055" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquired lock "refresh_cache-84b9cc72-7fbe-4667-8111-13c61211e055" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received event network-changed-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Refreshing instance network info cache due to event network-changed-7a1235ab-0a41-4a42-ae66-be2f8e0717b6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] Acquiring lock "refresh_cache-84b9cc72-7fbe-4667-8111-13c61211e055" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Updating instance_info_cache with network_info: [{"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Releasing lock "refresh_cache-84b9cc72-7fbe-4667-8111-13c61211e055" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Instance network_info: |[{"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] Acquired lock "refresh_cache-84b9cc72-7fbe-4667-8111-13c61211e055" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Refreshing network info cache for port 7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Start _get_guest_xml network_info=[{"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:00:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:00:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1726525375',display_name='tempest-VolumesActionsTest-instance-1726525375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1726525375',id=32,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='841f9f9b7f2b4a97a646419799d76f5f',ramdisk_id='',reservation_id='r-0e869ro2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1005026844',owner_user_name='tempest-VolumesActionsTest-1005026844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:00:56Z,user_data=None,user_id='50087f7e3cad4995a7a46903ff0f4a7a',uuid=84b9cc72-7fbe-4667-8111-13c61211e055,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Converting VIF {"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:91:2a,bridge_name='br-int',has_traffic_filtering=True,id=7a1235ab-0a41-4a42-ae66-be2f8e0717b6,network=Network(c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1235ab-0a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b9cc72-7fbe-4667-8111-13c61211e055 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:00:57 user nova-compute[75216]:   <uuid>84b9cc72-7fbe-4667-8111-13c61211e055</uuid>
Nov 02 05:00:57 user nova-compute[75216]:   <name>instance-00000020</name>
Nov 02 05:00:57 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:00:57 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:00:57 user nova-compute[75216]:   <metadata>
Nov 02 05:00:57 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:00:57 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:00:57 user nova-compute[75216]:       <nova:name>tempest-VolumesActionsTest-instance-1726525375</nova:name>
Nov 02 05:00:57 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:00:57</nova:creationTime>
Nov 02 05:00:57 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:00:57 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:00:57 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:00:57 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:00:57 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:00:57 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:00:57 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:00:57 user nova-compute[75216]:       <nova:owner>
Nov 02 05:00:57 user nova-compute[75216]:         <nova:user uuid="50087f7e3cad4995a7a46903ff0f4a7a">tempest-VolumesActionsTest-1005026844-project-member</nova:user>
Nov 02 05:00:57 user nova-compute[75216]:         <nova:project uuid="841f9f9b7f2b4a97a646419799d76f5f">tempest-VolumesActionsTest-1005026844</nova:project>
Nov 02 05:00:57 user nova-compute[75216]:       </nova:owner>
Nov 02 05:00:57 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:00:57 user nova-compute[75216]:       <nova:ports>
Nov 02 05:00:57 user nova-compute[75216]:         <nova:port uuid="7a1235ab-0a41-4a42-ae66-be2f8e0717b6">
Nov 02 05:00:57 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 05:00:57 user nova-compute[75216]:         </nova:port>
Nov 02 05:00:57 user nova-compute[75216]:       </nova:ports>
Nov 02 05:00:57 user nova-compute[75216]:     </nova:instance>
Nov 02 05:00:57 user nova-compute[75216]:   </metadata>
Nov 02 05:00:57 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:00:57 user nova-compute[75216]:     <system>
Nov 02 05:00:57 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:00:57 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:00:57 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:00:57 user nova-compute[75216]:       <entry name="serial">84b9cc72-7fbe-4667-8111-13c61211e055</entry>
Nov 02 05:00:57 user nova-compute[75216]:       <entry name="uuid">84b9cc72-7fbe-4667-8111-13c61211e055</entry>
Nov 02 05:00:57 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:00:57 user nova-compute[75216]:     </system>
Nov 02 05:00:57 user nova-compute[75216]:   </sysinfo>
Nov 02 05:00:57 user nova-compute[75216]:   <os>
Nov 02 05:00:57 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:00:57 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:00:57 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:00:57 user nova-compute[75216]:   </os>
Nov 02 05:00:57 user nova-compute[75216]:   <features>
Nov 02 05:00:57 user nova-compute[75216]:     <acpi/>
Nov 02 05:00:57 user nova-compute[75216]:     <apic/>
Nov 02 05:00:57 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:00:57 user nova-compute[75216]:   </features>
Nov 02 05:00:57 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:00:57 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:00:57 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:00:57 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:00:57 user nova-compute[75216]:   </clock>
Nov 02 05:00:57 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:00:57 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:00:57 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:00:57 user nova-compute[75216]:   </cpu>
Nov 02 05:00:57 user nova-compute[75216]:   <devices>
Nov 02 05:00:57 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:00:57 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:00:57 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk"/>
Nov 02 05:00:57 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:00:57 user nova-compute[75216]:     </disk>
Nov 02 05:00:57 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:00:57 user nova-compute[75216]:       <mac address="fa:16:3e:76:91:2a"/>
Nov 02 05:00:57 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:00:57 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:00:57 user nova-compute[75216]:       <target dev="tap7a1235ab-0a"/>
Nov 02 05:00:57 user nova-compute[75216]:     </interface>
Nov 02 05:00:57 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:00:57 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/console.log" append="off"/>
Nov 02 05:00:57 user nova-compute[75216]:     </serial>
Nov 02 05:00:57 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:00:57 user nova-compute[75216]:     <video>
Nov 02 05:00:57 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:00:57 user nova-compute[75216]:     </video>
Nov 02 05:00:57 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:00:57 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:00:57 user nova-compute[75216]:     </rng>
Nov 02 05:00:57 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:00:57 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:00:57 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:00:57 user nova-compute[75216]:     </memballoon>
Nov 02 05:00:57 user nova-compute[75216]:   </devices>
Nov 02 05:00:57 user nova-compute[75216]: </domain>
Nov 02 05:00:57 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1726525375',display_name='tempest-VolumesActionsTest-instance-1726525375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1726525375',id=32,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='841f9f9b7f2b4a97a646419799d76f5f',ramdisk_id='',reservation_id='r-0e869ro2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1005026844',owner_user_name='tempest-VolumesActionsTest-1005026844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:00:56Z,user_data=None,user_id='50087f7e3cad4995a7a46903ff0f4a7a',uuid=84b9cc72-7fbe-4667-8111-13c61211e055,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Converting VIF {"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:91:2a,bridge_name='br-int',has_traffic_filtering=True,id=7a1235ab-0a41-4a42-ae66-be2f8e0717b6,network=Network(c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1235ab-0a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG os_vif [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:91:2a,bridge_name='br-int',has_traffic_filtering=True,id=7a1235ab-0a41-4a42-ae66-be2f8e0717b6,network=Network(c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1235ab-0a') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21993685-65e8-5e51-bb50-1f13c0ed9cb8', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a1235ab-0a, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a1235ab-0a, col_values=(('qos', UUID('2a6fc1e7-84ff-48a2-857a-f8278be4faac')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a1235ab-0a, col_values=(('external_ids', {'iface-id': '7a1235ab-0a41-4a42-ae66-be2f8e0717b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:91:2a', 'vm-uuid': '84b9cc72-7fbe-4667-8111-13c61211e055'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:57 user nova-compute[75216]: INFO os_vif [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:91:2a,bridge_name='br-int',has_traffic_filtering=True,id=7a1235ab-0a41-4a42-ae66-be2f8e0717b6,network=Network(c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1235ab-0a')
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:00:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] No VIF found with MAC fa:16:3e:76:91:2a, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Updated VIF entry in instance network info cache for port 7a1235ab-0a41-4a42-ae66-be2f8e0717b6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Updating instance_info_cache with network_info: [{"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2d583a1f-3c55-429e-b88d-be77126f792a req-3920d0df-958e-46b2-87dd-c715eda416ec service nova] Releasing lock "refresh_cache-84b9cc72-7fbe-4667-8111-13c61211e055" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "0428e17f-9755-4632-96f3-fddcf65002a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "0428e17f-9755-4632-96f3-fddcf65002a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:00:58 user nova-compute[75216]: INFO nova.compute.claims [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Claim successful on node user
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:00:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.policy [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94f0b01ce0c744bdbb937e0a477dcf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eeaefe9a0e4468d9bbb99ba3aca7c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:59 user nova-compute[75216]: INFO nova.virt.block_device [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Booting with volume snapshot a8af06ef-7cdb-4422-81bb-2ef324616fc1 at /dev/vda
Nov 02 05:00:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-79fae83a-a42d-4bab-ac29-32ed566b6c70 req-4413ebbd-c67b-456c-ab80-0844a24b73a6 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received event network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79fae83a-a42d-4bab-ac29-32ed566b6c70 req-4413ebbd-c67b-456c-ab80-0844a24b73a6 service nova] Acquiring lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79fae83a-a42d-4bab-ac29-32ed566b6c70 req-4413ebbd-c67b-456c-ab80-0844a24b73a6 service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79fae83a-a42d-4bab-ac29-32ed566b6c70 req-4413ebbd-c67b-456c-ab80-0844a24b73a6 service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-79fae83a-a42d-4bab-ac29-32ed566b6c70 req-4413ebbd-c67b-456c-ab80-0844a24b73a6 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] No waiting events found dispatching network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:00:59 user nova-compute[75216]: WARNING nova.compute.manager [req-79fae83a-a42d-4bab-ac29-32ed566b6c70 req-4413ebbd-c67b-456c-ab80-0844a24b73a6 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received unexpected event network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 for instance with vm_state building and task_state spawning.
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:00:59 user nova-compute[75216]: INFO nova.compute.manager [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Terminating instance
Nov 02 05:00:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-1fc99a19-ca7b-4bc0-9092-739ad96fdd9a req-a8cabf44-013d-4c85-8f31-0a06b710fa4e service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received event network-vif-unplugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1fc99a19-ca7b-4bc0-9092-739ad96fdd9a req-a8cabf44-013d-4c85-8f31-0a06b710fa4e service nova] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1fc99a19-ca7b-4bc0-9092-739ad96fdd9a req-a8cabf44-013d-4c85-8f31-0a06b710fa4e service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1fc99a19-ca7b-4bc0-9092-739ad96fdd9a req-a8cabf44-013d-4c85-8f31-0a06b710fa4e service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-1fc99a19-ca7b-4bc0-9092-739ad96fdd9a req-a8cabf44-013d-4c85-8f31-0a06b710fa4e service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] No waiting events found dispatching network-vif-unplugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-1fc99a19-ca7b-4bc0-9092-739ad96fdd9a req-a8cabf44-013d-4c85-8f31-0a06b710fa4e service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received event network-vif-unplugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Successfully created port: 1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:01:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Instance destroyed successfully.
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lazy-loading 'resources' on Instance uuid ec15f413-2cb5-4dec-b2c5-1620b52caf7c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2115102231',display_name='tempest-ServersNegativeTestJSON-server-2115102231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2115102231',id=18,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11a39d43d2e4623884c15e26cc0641e',ramdisk_id='',reservation_id='r-ie8j324l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1245791276',owner_user_name='tempest-ServersNegativeTestJSON-1245791276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:51:35Z,user_data=None,user_id='123248b36fe94f2ebf8a2cb77d1b30cd',uuid=ec15f413-2cb5-4dec-b2c5-1620b52caf7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converting VIF {"id": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "address": "fa:16:3e:3f:d7:e9", "network": {"id": "871453fc-3226-4e6c-9c39-f5075c21c7ca", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-729369920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11a39d43d2e4623884c15e26cc0641e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap059ad0d2-cc", "ovs_interfaceid": "059ad0d2-cc57-4cb0-ab28-2de3a73bc693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d7:e9,bridge_name='br-int',has_traffic_filtering=True,id=059ad0d2-cc57-4cb0-ab28-2de3a73bc693,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ad0d2-cc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG os_vif [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d7:e9,bridge_name='br-int',has_traffic_filtering=True,id=059ad0d2-cc57-4cb0-ab28-2de3a73bc693,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ad0d2-cc') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap059ad0d2-cc, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd2304d8-68dc-4381-b546-de18461238c0) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:01 user nova-compute[75216]: INFO os_vif [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d7:e9,bridge_name='br-int',has_traffic_filtering=True,id=059ad0d2-cc57-4cb0-ab28-2de3a73bc693,network=Network(871453fc-3226-4e6c-9c39-f5075c21c7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059ad0d2-cc')
Nov 02 05:01:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Deleting instance files /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c_del
Nov 02 05:01:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Deletion of /opt/stack/data/nova/instances/ec15f413-2cb5-4dec-b2c5-1620b52caf7c_del complete
Nov 02 05:01:01 user nova-compute[75216]: INFO nova.compute.manager [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 02 05:01:01 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-433ca5c8-3930-4c9e-b61f-58afc982faca req-5fb35876-dec5-4833-9611-1115bd84917f service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received event network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433ca5c8-3930-4c9e-b61f-58afc982faca req-5fb35876-dec5-4833-9611-1115bd84917f service nova] Acquiring lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433ca5c8-3930-4c9e-b61f-58afc982faca req-5fb35876-dec5-4833-9611-1115bd84917f service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-433ca5c8-3930-4c9e-b61f-58afc982faca req-5fb35876-dec5-4833-9611-1115bd84917f service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-433ca5c8-3930-4c9e-b61f-58afc982faca req-5fb35876-dec5-4833-9611-1115bd84917f service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] No waiting events found dispatching network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:01 user nova-compute[75216]: WARNING nova.compute.manager [req-433ca5c8-3930-4c9e-b61f-58afc982faca req-5fb35876-dec5-4833-9611-1115bd84917f service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received unexpected event network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 for instance with vm_state building and task_state spawning.
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Successfully updated port: 1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "refresh_cache-0428e17f-9755-4632-96f3-fddcf65002a1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquired lock "refresh_cache-0428e17f-9755-4632-96f3-fddcf65002a1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:01:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:01:02 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Took 0.94 seconds to deallocate network for instance.
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-5687c6a8-eaf6-4ae5-9cbd-05ed70dd687e req-bd107df1-94d2-424a-8abf-ff4c4bd90bf0 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received event network-vif-deleted-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Updating instance_info_cache with network_info: [{"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Releasing lock "refresh_cache-0428e17f-9755-4632-96f3-fddcf65002a1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Instance network_info: |[{"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:01:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Instance spawned successfully.
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:02 user nova-compute[75216]: INFO nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:01:02 user nova-compute[75216]: INFO nova.compute.manager [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Took 7.68 seconds to build instance.
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0212dc2-5d01-4703-a7aa-3b85d717be02 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "84b9cc72-7fbe-4667-8111-13c61211e055" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.810s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received event network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] Acquiring lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] No waiting events found dispatching network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:02 user nova-compute[75216]: WARNING nova.compute.manager [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: ec15f413-2cb5-4dec-b2c5-1620b52caf7c] Received unexpected event network-vif-plugged-059ad0d2-cc57-4cb0-ab28-2de3a73bc693 for instance with vm_state deleted and task_state None.
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received event network-changed-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Refreshing instance network info cache due to event network-changed-1b140321-a34e-45a4-9db2-3ea0ce0117ac. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] Acquiring lock "refresh_cache-0428e17f-9755-4632-96f3-fddcf65002a1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] Acquired lock "refresh_cache-0428e17f-9755-4632-96f3-fddcf65002a1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Refreshing network info cache for port 1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:01:02 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Deleted allocations for instance ec15f413-2cb5-4dec-b2c5-1620b52caf7c
Nov 02 05:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9201a104-d039-49ba-b589-a0d805a64d5c tempest-ServersNegativeTestJSON-1245791276 tempest-ServersNegativeTestJSON-1245791276-project-member] Lock "ec15f413-2cb5-4dec-b2c5-1620b52caf7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.030s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Updated VIF entry in instance network info cache for port 1b140321-a34e-45a4-9db2-3ea0ce0117ac. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:01:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Updating instance_info_cache with network_info: [{"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:01:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d406c8b0-4a48-40ed-991b-e627a6b51a6a req-0f25d756-6e77-4afa-9440-5b2e1cba7f18 service nova] Releasing lock "refresh_cache-0428e17f-9755-4632-96f3-fddcf65002a1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:04 user nova-compute[75216]: INFO nova.compute.manager [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Terminating instance
Nov 02 05:01:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-52598fa1-c949-4148-9c75-6e82c6b0f3c2 req-0e992fdb-0249-4469-93ec-92faea9416a5 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52598fa1-c949-4148-9c75-6e82c6b0f3c2 req-0e992fdb-0249-4469-93ec-92faea9416a5 service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52598fa1-c949-4148-9c75-6e82c6b0f3c2 req-0e992fdb-0249-4469-93ec-92faea9416a5 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52598fa1-c949-4148-9c75-6e82c6b0f3c2 req-0e992fdb-0249-4469-93ec-92faea9416a5 service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-52598fa1-c949-4148-9c75-6e82c6b0f3c2 req-0e992fdb-0249-4469-93ec-92faea9416a5 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-52598fa1-c949-4148-9c75-6e82c6b0f3c2 req-0e992fdb-0249-4469-93ec-92faea9416a5 service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-unplugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Instance destroyed successfully.
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'resources' on Instance uuid 48c33b8f-cdd5-452e-9c39-3e5504db6b1f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413566755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413566755',id=27,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-k1ojyas8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:59:19Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=48c33b8f-cdd5-452e-9c39-3e5504db6b1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "464a9293-b58e-4233-9747-71ecf5994bd9", "address": "fa:16:3e:1c:3a:87", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464a9293-b5", "ovs_interfaceid": "464a9293-b58e-4233-9747-71ecf5994bd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_vif [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap464a9293-b5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=770f853d-ca2b-4126-bd65-9dd850a4c2bd) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:05 user nova-compute[75216]: INFO os_vif [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3a:87,bridge_name='br-int',has_traffic_filtering=True,id=464a9293-b58e-4233-9747-71ecf5994bd9,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464a9293-b5')
Nov 02 05:01:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUGKjhEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:01:05 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5ee55-d9e6-442c-a4ac-9873eb76d7ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:01:05 user nova-compute[75216]: No targets found.
Nov 02 05:01:05 user nova-compute[75216]: iSNS:
Nov 02 05:01:05 user nova-compute[75216]: No targets found.
Nov 02 05:01:05 user nova-compute[75216]: STATIC:
Nov 02 05:01:05 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4
Nov 02 05:01:05 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:01:05 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:01:05 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 05:01:05 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:01:05 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:01:05 user nova-compute[75216]: FIRMWARE:
Nov 02 05:01:05 user nova-compute[75216]: No targets found.
Nov 02 05:01:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:01:05 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:01:05 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[595844f7-6c19-4130-89c7-5c17e24435e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627f2e4-b472-4e14-aeb1-0c82afbbb4b4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:01:05 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 05:01:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:01:05 user nova-compute[75216]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 (non-flash)
Nov 02 05:01:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460413f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[849a5c17-0e1e-4de0-8ab4-874cb4fc94b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca1b561-73b4-42af-9c55-e3a75f9de2c5]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[562ad69a-f77e-4726-aa8e-a29912739bba]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11b53cd-f150-4a3e-9961-ab2c5eefbb6a]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_793ffe18', '/dev/disk/by-id/scsi-23437623533346464', '/dev/disk/by-id/scsi-1SCST_BIO793ffe18-47b534dd58d6e4a5') {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0284b0fd-a69e-4732-a607-be578809b030]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.101s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764a21d-e327-488d-b491-3af3355a09ec]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[72600f36-0069-4fc4-a03d-4022be22a578]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260]
Nov 02 05:01:06 user nova-compute[75216]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4, portal: 172.16.0.220,3260] successful.
Nov 02 05:01:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fb11303-8f48-490e-86f7-f904a2fe33b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe8f14-ca2e-4e11-b09b-28f86c318059]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== disconnect_volume: return (428ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:01:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Deleting instance files /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f_del
Nov 02 05:01:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Deletion of /opt/stack/data/nova/instances/48c33b8f-cdd5-452e-9c39-3e5504db6b1f_del complete
Nov 02 05:01:06 user nova-compute[75216]: INFO nova.compute.manager [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 02 05:01:06 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:06 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:01:06 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Took 0.53 seconds to deallocate network for instance.
Nov 02 05:01:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba27be3-cfef-4978-a97e-90e43eb76577 req-b2b56dc2-d824-4f7b-90b0-c32d388358ab service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba27be3-cfef-4978-a97e-90e43eb76577 req-b2b56dc2-d824-4f7b-90b0-c32d388358ab service nova] Acquiring lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba27be3-cfef-4978-a97e-90e43eb76577 req-b2b56dc2-d824-4f7b-90b0-c32d388358ab service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ba27be3-cfef-4978-a97e-90e43eb76577 req-b2b56dc2-d824-4f7b-90b0-c32d388358ab service nova] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba27be3-cfef-4978-a97e-90e43eb76577 req-b2b56dc2-d824-4f7b-90b0-c32d388358ab service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] No waiting events found dispatching network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:07 user nova-compute[75216]: WARNING nova.compute.manager [req-1ba27be3-cfef-4978-a97e-90e43eb76577 req-b2b56dc2-d824-4f7b-90b0-c32d388358ab service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received unexpected event network-vif-plugged-464a9293-b58e-4233-9747-71ecf5994bd9 for instance with vm_state active and task_state deleting.
Nov 02 05:01:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ba27be3-cfef-4978-a97e-90e43eb76577 req-b2b56dc2-d824-4f7b-90b0-c32d388358ab service nova] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Received event network-vif-deleted-464a9293-b58e-4233-9747-71ecf5994bd9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:07 user nova-compute[75216]: INFO nova.compute.manager [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 48c33b8f-cdd5-452e-9c39-3e5504db6b1f] Took 0.94 seconds to detach 1 volumes for instance.
Nov 02 05:01:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:01:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:01:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:08 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Deleted allocations for instance 48c33b8f-cdd5-452e-9c39-3e5504db6b1f
Nov 02 05:01:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbfc591c-79ea-4bcb-90eb-b133fbbba5c9 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "48c33b8f-cdd5-452e-9c39-3e5504db6b1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.498s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[693df0e6-8ef3-437f-8111-783eef01126d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e9b394-31ed-4ec8-a9e2-b4fc32ea1973]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fab98e-762b-461b-87ab-f59d0e677c66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8daab73-90e1-44d5-94af-d3fd5bb29dcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:01:11 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a9858-d74c-4aa5-b8a9-82d4a780d115]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Updating existing volume attachment record: b71ac508-7501-490a-9d74-4a8f20b6b9f2 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:01:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:01:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8014MB free_disk=24.945556640625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance af65cc0f-3880-4df7-8c62-61efbcc110fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 84b9cc72-7fbe-4667-8111-13c61211e055 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0428e17f-9755-4632-96f3-fddcf65002a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:01:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:01:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:01:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:01:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:01:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Creating image(s)
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Ensure instance console log exists: /opt/stack/data/nova/instances/0428e17f-9755-4632-96f3-fddcf65002a1/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Start _get_guest_xml network_info=[{"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b71ac508-7501-490a-9d74-4a8f20b6b9f2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFtVjobl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0428e17f-9755-4632-96f3-fddcf65002a1', 'attached_at': '', 'detached_at': '', 'volume_id': '82f56cff-3ec3-4847-9b79-398eb1a489eb', 'serial': '82f56cff-3ec3-4847-9b79-398eb1a489eb'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:01:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:01:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFtVjobl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:01:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:01:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:01:33 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f630764-9701-4de4-ad0f-ae9b066c3586]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:01:33 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[696efdf4-071a-4a81-ad9a-9d2dd477ebe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb] added
Nov 02 05:01:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c1f3b-8cab-4244-ac3d-f56c24e28653]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea9de85-3e16-47c6-8b85-8d0ac35c0f74]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFtVjobl {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFtVjobl" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee36af2c-ea28-4198-bd1d-d802743ce40e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFtVjobl'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29465397-1095-4d24-a5a2-3ca6be06cebe]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff1c01c-24bf-4321-998b-82d8d34829a1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:01:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:01:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a61207-71bc-450c-a1c8-20012cf123c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260]
Nov 02 05:01:33 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260] successful.
Nov 02 05:01:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb491263-8f93-49fe-b37d-9062367ce22c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca772895-20f2-48e4-99ec-d5f4355fac86]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:01:33 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)
Nov 02 05:01:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:01:33 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)
Nov 02 05:01:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaee3b8-24d1-486e-8493-6676e454908f]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:01:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFtVjobl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23933623162373261', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933623162373261', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1916112975',display_name='tempest-TestVolumeBootPattern-server-1916112975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1916112975',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-tp4wbi7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:00:59Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=0428e17f-9755-4632-96f3-fddcf65002a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8c:9a,bridge_name='br-int',has_traffic_filtering=True,id=1b140321-a34e-45a4-9db2-3ea0ce0117ac,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b140321-a3') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'pci_devices' on Instance uuid 0428e17f-9755-4632-96f3-fddcf65002a1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:01:34 user nova-compute[75216]:   <uuid>0428e17f-9755-4632-96f3-fddcf65002a1</uuid>
Nov 02 05:01:34 user nova-compute[75216]:   <name>instance-00000021</name>
Nov 02 05:01:34 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:01:34 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:01:34 user nova-compute[75216]:   <metadata>
Nov 02 05:01:34 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:01:34 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:01:34 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-1916112975</nova:name>
Nov 02 05:01:34 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:01:33</nova:creationTime>
Nov 02 05:01:34 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:01:34 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:01:34 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:01:34 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:01:34 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:01:34 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:01:34 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:01:34 user nova-compute[75216]:       <nova:owner>
Nov 02 05:01:34 user nova-compute[75216]:         <nova:user uuid="94f0b01ce0c744bdbb937e0a477dcf07">tempest-TestVolumeBootPattern-773799094-project-member</nova:user>
Nov 02 05:01:34 user nova-compute[75216]:         <nova:project uuid="9eeaefe9a0e4468d9bbb99ba3aca7c64">tempest-TestVolumeBootPattern-773799094</nova:project>
Nov 02 05:01:34 user nova-compute[75216]:       </nova:owner>
Nov 02 05:01:34 user nova-compute[75216]:       <nova:ports>
Nov 02 05:01:34 user nova-compute[75216]:         <nova:port uuid="1b140321-a34e-45a4-9db2-3ea0ce0117ac">
Nov 02 05:01:34 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 05:01:34 user nova-compute[75216]:         </nova:port>
Nov 02 05:01:34 user nova-compute[75216]:       </nova:ports>
Nov 02 05:01:34 user nova-compute[75216]:     </nova:instance>
Nov 02 05:01:34 user nova-compute[75216]:   </metadata>
Nov 02 05:01:34 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:01:34 user nova-compute[75216]:     <system>
Nov 02 05:01:34 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:01:34 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:01:34 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:01:34 user nova-compute[75216]:       <entry name="serial">0428e17f-9755-4632-96f3-fddcf65002a1</entry>
Nov 02 05:01:34 user nova-compute[75216]:       <entry name="uuid">0428e17f-9755-4632-96f3-fddcf65002a1</entry>
Nov 02 05:01:34 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:01:34 user nova-compute[75216]:     </system>
Nov 02 05:01:34 user nova-compute[75216]:   </sysinfo>
Nov 02 05:01:34 user nova-compute[75216]:   <os>
Nov 02 05:01:34 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:01:34 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:01:34 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:01:34 user nova-compute[75216]:   </os>
Nov 02 05:01:34 user nova-compute[75216]:   <features>
Nov 02 05:01:34 user nova-compute[75216]:     <acpi/>
Nov 02 05:01:34 user nova-compute[75216]:     <apic/>
Nov 02 05:01:34 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:01:34 user nova-compute[75216]:   </features>
Nov 02 05:01:34 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:01:34 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:01:34 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:01:34 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:01:34 user nova-compute[75216]:   </clock>
Nov 02 05:01:34 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:01:34 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:01:34 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:01:34 user nova-compute[75216]:   </cpu>
Nov 02 05:01:34 user nova-compute[75216]:   <devices>
Nov 02 05:01:34 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:01:34 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:01:34 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 05:01:34 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:01:34 user nova-compute[75216]:       <serial>82f56cff-3ec3-4847-9b79-398eb1a489eb</serial>
Nov 02 05:01:34 user nova-compute[75216]:     </disk>
Nov 02 05:01:34 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:01:34 user nova-compute[75216]:       <mac address="fa:16:3e:84:8c:9a"/>
Nov 02 05:01:34 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:01:34 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:01:34 user nova-compute[75216]:       <target dev="tap1b140321-a3"/>
Nov 02 05:01:34 user nova-compute[75216]:     </interface>
Nov 02 05:01:34 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:01:34 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/0428e17f-9755-4632-96f3-fddcf65002a1/console.log" append="off"/>
Nov 02 05:01:34 user nova-compute[75216]:     </serial>
Nov 02 05:01:34 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:01:34 user nova-compute[75216]:     <video>
Nov 02 05:01:34 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:01:34 user nova-compute[75216]:     </video>
Nov 02 05:01:34 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:01:34 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:01:34 user nova-compute[75216]:     </rng>
Nov 02 05:01:34 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:01:34 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:01:34 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:01:34 user nova-compute[75216]:     </memballoon>
Nov 02 05:01:34 user nova-compute[75216]:   </devices>
Nov 02 05:01:34 user nova-compute[75216]: </domain>
Nov 02 05:01:34 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1916112975',display_name='tempest-TestVolumeBootPattern-server-1916112975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1916112975',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-tp4wbi7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:00:59Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=0428e17f-9755-4632-96f3-fddcf65002a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8c:9a,bridge_name='br-int',has_traffic_filtering=True,id=1b140321-a34e-45a4-9db2-3ea0ce0117ac,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b140321-a3') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG os_vif [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8c:9a,bridge_name='br-int',has_traffic_filtering=True,id=1b140321-a34e-45a4-9db2-3ea0ce0117ac,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b140321-a3') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcd5de7b-772a-50c5-92fb-734b8dab1f60', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b140321-a3, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b140321-a3, col_values=(('qos', UUID('0dafb918-e115-4aeb-9b6c-8b30fa6fa36f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b140321-a3, col_values=(('external_ids', {'iface-id': '1b140321-a34e-45a4-9db2-3ea0ce0117ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:8c:9a', 'vm-uuid': '0428e17f-9755-4632-96f3-fddcf65002a1'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:34 user nova-compute[75216]: INFO os_vif [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8c:9a,bridge_name='br-int',has_traffic_filtering=True,id=1b140321-a34e-45a4-9db2-3ea0ce0117ac,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b140321-a3')
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:01:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No VIF found with MAC fa:16:3e:84:8c:9a, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:01:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-3e598cd7-cf99-4bd9-bbd4-35ddfc904542 req-d08ec43d-ddfd-40bd-9c6b-0138db467f22 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received event network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e598cd7-cf99-4bd9-bbd4-35ddfc904542 req-d08ec43d-ddfd-40bd-9c6b-0138db467f22 service nova] Acquiring lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e598cd7-cf99-4bd9-bbd4-35ddfc904542 req-d08ec43d-ddfd-40bd-9c6b-0138db467f22 service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e598cd7-cf99-4bd9-bbd4-35ddfc904542 req-d08ec43d-ddfd-40bd-9c6b-0138db467f22 service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-3e598cd7-cf99-4bd9-bbd4-35ddfc904542 req-d08ec43d-ddfd-40bd-9c6b-0138db467f22 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] No waiting events found dispatching network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:36 user nova-compute[75216]: WARNING nova.compute.manager [req-3e598cd7-cf99-4bd9-bbd4-35ddfc904542 req-d08ec43d-ddfd-40bd-9c6b-0138db467f22 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received unexpected event network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac for instance with vm_state building and task_state spawning.
Nov 02 05:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:01:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Instance spawned successfully.
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:38 user nova-compute[75216]: INFO nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:01:38 user nova-compute[75216]: INFO nova.compute.manager [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Took 39.38 seconds to build instance.
Nov 02 05:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2590771c-ee46-4d1e-82c8-77220da3d9d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "0428e17f-9755-4632-96f3-fddcf65002a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.502s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-a024c9b6-4b69-4e34-8c2f-a6e87f6eef2a req-fdbe0e77-ac47-4a62-808e-2ad59d16055f service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received event network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a024c9b6-4b69-4e34-8c2f-a6e87f6eef2a req-fdbe0e77-ac47-4a62-808e-2ad59d16055f service nova] Acquiring lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a024c9b6-4b69-4e34-8c2f-a6e87f6eef2a req-fdbe0e77-ac47-4a62-808e-2ad59d16055f service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a024c9b6-4b69-4e34-8c2f-a6e87f6eef2a req-fdbe0e77-ac47-4a62-808e-2ad59d16055f service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-a024c9b6-4b69-4e34-8c2f-a6e87f6eef2a req-fdbe0e77-ac47-4a62-808e-2ad59d16055f service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] No waiting events found dispatching network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:38 user nova-compute[75216]: WARNING nova.compute.manager [req-a024c9b6-4b69-4e34-8c2f-a6e87f6eef2a req-fdbe0e77-ac47-4a62-808e-2ad59d16055f service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received unexpected event network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac for instance with vm_state active and task_state None.
Nov 02 05:01:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:01:39 user nova-compute[75216]: INFO nova.compute.claims [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Claim successful on node user
Nov 02 05:01:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:01:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:01:39 user nova-compute[75216]: DEBUG nova.policy [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049f40a6f12742aaa3192675b09644a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca67de068e45497ba3286b5c50da9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:01:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Creating image(s)
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk 1073741824" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Successfully created port: 57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Cannot resize image /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Ensure instance console log exists: /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Successfully updated port: 57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquired lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing instance network info cache due to event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] Acquiring lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Releasing lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance network_info: |[{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] Acquired lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Start _get_guest_xml network_info=[{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:01:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:01:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2088799543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2088799543',id=34,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp/OO6sRIUyd7lJWqOohJY7Okmd7HecjmvgLRJ/CmJZ/1xScmDAxFb8TwNkKtAm4mJGJ1O5rTfrxPxdMxXi5fWjnWXo8KDBv6eTtt8Ksivq3jY1j1FW4P3f3pJuj2mLfQ==',key_name='tempest-keypair-117377760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-sm1vnak4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=bcd6130f-c66d-4e4c-80f8-e61d59f662f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:01:41 user nova-compute[75216]:   <uuid>bcd6130f-c66d-4e4c-80f8-e61d59f662f1</uuid>
Nov 02 05:01:41 user nova-compute[75216]:   <name>instance-00000022</name>
Nov 02 05:01:41 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:01:41 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:01:41 user nova-compute[75216]:   <metadata>
Nov 02 05:01:41 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:01:41 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:01:41 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2088799543</nova:name>
Nov 02 05:01:41 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:01:41</nova:creationTime>
Nov 02 05:01:41 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:01:41 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:01:41 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:01:41 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:01:41 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:01:41 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:01:41 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:01:41 user nova-compute[75216]:       <nova:owner>
Nov 02 05:01:41 user nova-compute[75216]:         <nova:user uuid="049f40a6f12742aaa3192675b09644a6">tempest-AttachVolumeShelveTestJSON-1661619051-project-member</nova:user>
Nov 02 05:01:41 user nova-compute[75216]:         <nova:project uuid="ca67de068e45497ba3286b5c50da9335">tempest-AttachVolumeShelveTestJSON-1661619051</nova:project>
Nov 02 05:01:41 user nova-compute[75216]:       </nova:owner>
Nov 02 05:01:41 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:01:41 user nova-compute[75216]:       <nova:ports>
Nov 02 05:01:41 user nova-compute[75216]:         <nova:port uuid="57f48792-35ab-4c28-a363-c3672ed3ffda">
Nov 02 05:01:41 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 05:01:41 user nova-compute[75216]:         </nova:port>
Nov 02 05:01:41 user nova-compute[75216]:       </nova:ports>
Nov 02 05:01:41 user nova-compute[75216]:     </nova:instance>
Nov 02 05:01:41 user nova-compute[75216]:   </metadata>
Nov 02 05:01:41 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:01:41 user nova-compute[75216]:     <system>
Nov 02 05:01:41 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:01:41 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:01:41 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:01:41 user nova-compute[75216]:       <entry name="serial">bcd6130f-c66d-4e4c-80f8-e61d59f662f1</entry>
Nov 02 05:01:41 user nova-compute[75216]:       <entry name="uuid">bcd6130f-c66d-4e4c-80f8-e61d59f662f1</entry>
Nov 02 05:01:41 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:01:41 user nova-compute[75216]:     </system>
Nov 02 05:01:41 user nova-compute[75216]:   </sysinfo>
Nov 02 05:01:41 user nova-compute[75216]:   <os>
Nov 02 05:01:41 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:01:41 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:01:41 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:01:41 user nova-compute[75216]:   </os>
Nov 02 05:01:41 user nova-compute[75216]:   <features>
Nov 02 05:01:41 user nova-compute[75216]:     <acpi/>
Nov 02 05:01:41 user nova-compute[75216]:     <apic/>
Nov 02 05:01:41 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:01:41 user nova-compute[75216]:   </features>
Nov 02 05:01:41 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:01:41 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:01:41 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:01:41 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:01:41 user nova-compute[75216]:   </clock>
Nov 02 05:01:41 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:01:41 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:01:41 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:01:41 user nova-compute[75216]:   </cpu>
Nov 02 05:01:41 user nova-compute[75216]:   <devices>
Nov 02 05:01:41 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:01:41 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:01:41 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk"/>
Nov 02 05:01:41 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:01:41 user nova-compute[75216]:     </disk>
Nov 02 05:01:41 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:01:41 user nova-compute[75216]:       <mac address="fa:16:3e:13:d2:a0"/>
Nov 02 05:01:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:01:41 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:01:41 user nova-compute[75216]:       <target dev="tap57f48792-35"/>
Nov 02 05:01:41 user nova-compute[75216]:     </interface>
Nov 02 05:01:41 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:01:41 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/console.log" append="off"/>
Nov 02 05:01:41 user nova-compute[75216]:     </serial>
Nov 02 05:01:41 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:01:41 user nova-compute[75216]:     <video>
Nov 02 05:01:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:01:41 user nova-compute[75216]:     </video>
Nov 02 05:01:41 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:01:41 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:01:41 user nova-compute[75216]:     </rng>
Nov 02 05:01:41 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:01:41 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:01:41 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:01:41 user nova-compute[75216]:     </memballoon>
Nov 02 05:01:41 user nova-compute[75216]:   </devices>
Nov 02 05:01:41 user nova-compute[75216]: </domain>
Nov 02 05:01:41 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2088799543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2088799543',id=34,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp/OO6sRIUyd7lJWqOohJY7Okmd7HecjmvgLRJ/CmJZ/1xScmDAxFb8TwNkKtAm4mJGJ1O5rTfrxPxdMxXi5fWjnWXo8KDBv6eTtt8Ksivq3jY1j1FW4P3f3pJuj2mLfQ==',key_name='tempest-keypair-117377760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-sm1vnak4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=bcd6130f-c66d-4e4c-80f8-e61d59f662f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG os_vif [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54ccf2c6-1345-5cdd-8294-8284fcf241d1', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57f48792-35, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57f48792-35, col_values=(('qos', UUID('b00e3968-00a5-4adb-ad00-36c802ae13b9')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57f48792-35, col_values=(('external_ids', {'iface-id': '57f48792-35ab-4c28-a363-c3672ed3ffda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:d2:a0', 'vm-uuid': 'bcd6130f-c66d-4e4c-80f8-e61d59f662f1'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:41 user nova-compute[75216]: INFO os_vif [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35')
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:01:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No VIF found with MAC fa:16:3e:13:d2:a0, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:01:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updated VIF entry in instance network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:01:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1364fd75-e88c-4cdd-bc31-1fc7705833d0 req-b88af64f-4d63-451b-8488-370563b7ee77 service nova] Releasing lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-2879300f-191e-41e9-bf21-45addfd2b90a req-8b5cc87b-22f9-45ac-bcd1-9dccd5386505 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2879300f-191e-41e9-bf21-45addfd2b90a req-8b5cc87b-22f9-45ac-bcd1-9dccd5386505 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2879300f-191e-41e9-bf21-45addfd2b90a req-8b5cc87b-22f9-45ac-bcd1-9dccd5386505 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2879300f-191e-41e9-bf21-45addfd2b90a req-8b5cc87b-22f9-45ac-bcd1-9dccd5386505 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-2879300f-191e-41e9-bf21-45addfd2b90a req-8b5cc87b-22f9-45ac-bcd1-9dccd5386505 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:43 user nova-compute[75216]: WARNING nova.compute.manager [req-2879300f-191e-41e9-bf21-45addfd2b90a req-8b5cc87b-22f9-45ac-bcd1-9dccd5386505 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state building and task_state spawning.
Nov 02 05:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:01:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance spawned successfully.
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-1251f0b6-5d0e-481e-922a-4b6b8e340092 req-15fec339-10bb-419f-9b3f-7c7c2c7ef266 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1251f0b6-5d0e-481e-922a-4b6b8e340092 req-15fec339-10bb-419f-9b3f-7c7c2c7ef266 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1251f0b6-5d0e-481e-922a-4b6b8e340092 req-15fec339-10bb-419f-9b3f-7c7c2c7ef266 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1251f0b6-5d0e-481e-922a-4b6b8e340092 req-15fec339-10bb-419f-9b3f-7c7c2c7ef266 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-1251f0b6-5d0e-481e-922a-4b6b8e340092 req-15fec339-10bb-419f-9b3f-7c7c2c7ef266 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:45 user nova-compute[75216]: WARNING nova.compute.manager [req-1251f0b6-5d0e-481e-922a-4b6b8e340092 req-15fec339-10bb-419f-9b3f-7c7c2c7ef266 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state building and task_state spawning.
Nov 02 05:01:45 user nova-compute[75216]: INFO nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 02 05:01:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:01:45 user nova-compute[75216]: INFO nova.compute.manager [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Took 6.55 seconds to build instance.
Nov 02 05:01:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0e08cd5-e050-44c9-931b-23e6c961220e tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.652s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:55 user nova-compute[75216]: INFO nova.compute.manager [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Terminating instance
Nov 02 05:01:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:01:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-b7548576-daa9-4c4e-867f-fb55e2a407b0 req-6dcdd761-4fde-43ce-8223-18ba9c3fad94 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received event network-vif-unplugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7548576-daa9-4c4e-867f-fb55e2a407b0 req-6dcdd761-4fde-43ce-8223-18ba9c3fad94 service nova] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7548576-daa9-4c4e-867f-fb55e2a407b0 req-6dcdd761-4fde-43ce-8223-18ba9c3fad94 service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b7548576-daa9-4c4e-867f-fb55e2a407b0 req-6dcdd761-4fde-43ce-8223-18ba9c3fad94 service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-b7548576-daa9-4c4e-867f-fb55e2a407b0 req-6dcdd761-4fde-43ce-8223-18ba9c3fad94 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] No waiting events found dispatching network-vif-unplugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-b7548576-daa9-4c4e-867f-fb55e2a407b0 req-6dcdd761-4fde-43ce-8223-18ba9c3fad94 service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received event network-vif-unplugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Instance destroyed successfully.
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'resources' on Instance uuid b2016901-3f50-4de3-8eb1-ffa4c67e2b78 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2036422927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2036422927',id=19,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-akhr64kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:53:36Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=b2016901-3f50-4de3-8eb1-ffa4c67e2b78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "address": "fa:16:3e:5a:06:f2", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569fa55c-2d", "ovs_interfaceid": "569fa55c-2d6d-416a-ae2b-08de61f89d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:06:f2,bridge_name='br-int',has_traffic_filtering=True,id=569fa55c-2d6d-416a-ae2b-08de61f89d4d,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569fa55c-2d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG os_vif [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:06:f2,bridge_name='br-int',has_traffic_filtering=True,id=569fa55c-2d6d-416a-ae2b-08de61f89d4d,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569fa55c-2d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap569fa55c-2d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d4458bd-4916-405a-879d-7f5a03e0b78d) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:01:56 user nova-compute[75216]: INFO os_vif [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:06:f2,bridge_name='br-int',has_traffic_filtering=True,id=569fa55c-2d6d-416a-ae2b-08de61f89d4d,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569fa55c-2d')
Nov 02 05:01:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Deleting instance files /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78_del
Nov 02 05:01:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Deletion of /opt/stack/data/nova/instances/b2016901-3f50-4de3-8eb1-ffa4c67e2b78_del complete
Nov 02 05:01:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:01:56 user nova-compute[75216]: INFO nova.compute.manager [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 02 05:01:56 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:01:56 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:01:57 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:01:57 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Took 0.49 seconds to deallocate network for instance.
Nov 02 05:01:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:01:57 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:01:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:57 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Deleted allocations for instance b2016901-3f50-4de3-8eb1-ffa4c67e2b78
Nov 02 05:01:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4af64164-8541-458c-8d41-c31a1cb9acd1 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.630s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-ddad9103-66dc-413f-b144-fb24d588ec5c req-9ff16938-fcba-4df6-8484-2034bdfc9f6a service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received event network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ddad9103-66dc-413f-b144-fb24d588ec5c req-9ff16938-fcba-4df6-8484-2034bdfc9f6a service nova] Acquiring lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ddad9103-66dc-413f-b144-fb24d588ec5c req-9ff16938-fcba-4df6-8484-2034bdfc9f6a service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ddad9103-66dc-413f-b144-fb24d588ec5c req-9ff16938-fcba-4df6-8484-2034bdfc9f6a service nova] Lock "b2016901-3f50-4de3-8eb1-ffa4c67e2b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:01:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-ddad9103-66dc-413f-b144-fb24d588ec5c req-9ff16938-fcba-4df6-8484-2034bdfc9f6a service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] No waiting events found dispatching network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:01:58 user nova-compute[75216]: WARNING nova.compute.manager [req-ddad9103-66dc-413f-b144-fb24d588ec5c req-9ff16938-fcba-4df6-8484-2034bdfc9f6a service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received unexpected event network-vif-plugged-569fa55c-2d6d-416a-ae2b-08de61f89d4d for instance with vm_state deleted and task_state None.
Nov 02 05:01:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-ddad9103-66dc-413f-b144-fb24d588ec5c req-9ff16938-fcba-4df6-8484-2034bdfc9f6a service nova] [instance: b2016901-3f50-4de3-8eb1-ffa4c67e2b78] Received event network-vif-deleted-569fa55c-2d6d-416a-ae2b-08de61f89d4d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:02:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:02:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7901MB free_disk=25.01177978515625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 43182725-9f83-4afd-a243-49d838e7d811 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance af65cc0f-3880-4df7-8c62-61efbcc110fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 84b9cc72-7fbe-4667-8111-13c61211e055 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0428e17f-9755-4632-96f3-fddcf65002a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:02:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:02:21 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:02:21 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:02:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:02:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 3b055742-c605-41ab-bd40-1a777b8f4e39 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updating instance_info_cache with network_info: [{"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-3b055742-c605-41ab-bd40-1a777b8f4e39" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:02:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:02:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:02:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:02:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:02:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:02:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:02:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "43182725-9f83-4afd-a243-49d838e7d811" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:46 user nova-compute[75216]: INFO nova.compute.manager [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Terminating instance
Nov 02 05:02:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a81722d-e68f-4b30-b40f-15559542b030 req-fde8fe16-3200-42fa-afff-6478bcc5a68e service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a81722d-e68f-4b30-b40f-15559542b030 req-fde8fe16-3200-42fa-afff-6478bcc5a68e service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a81722d-e68f-4b30-b40f-15559542b030 req-fde8fe16-3200-42fa-afff-6478bcc5a68e service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a81722d-e68f-4b30-b40f-15559542b030 req-fde8fe16-3200-42fa-afff-6478bcc5a68e service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a81722d-e68f-4b30-b40f-15559542b030 req-fde8fe16-3200-42fa-afff-6478bcc5a68e service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a81722d-e68f-4b30-b40f-15559542b030 req-fde8fe16-3200-42fa-afff-6478bcc5a68e service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-unplugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Instance destroyed successfully.
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'resources' on Instance uuid 43182725-9f83-4afd-a243-49d838e7d811 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-662356066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-662356066',id=12,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-50m6mqgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:49:51Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=43182725-9f83-4afd-a243-49d838e7d811,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "address": "fa:16:3e:9b:35:37", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e2b5f1c-63", "ovs_interfaceid": "1e2b5f1c-63f6-4ba4-883d-c528768387a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_vif [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e2b5f1c-63, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5484638e-cd8b-43ec-965b-bf922b328147) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:47 user nova-compute[75216]: INFO os_vif [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:35:37,bridge_name='br-int',has_traffic_filtering=True,id=1e2b5f1c-63f6-4ba4-883d-c528768387a4,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e2b5f1c-63')
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYWhSnDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:02:47 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe72708-7e53-4068-93c3-463025994c7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:02:47 user nova-compute[75216]: No targets found.
Nov 02 05:02:47 user nova-compute[75216]: iSNS:
Nov 02 05:02:47 user nova-compute[75216]: No targets found.
Nov 02 05:02:47 user nova-compute[75216]: STATIC:
Nov 02 05:02:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb
Nov 02 05:02:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:02:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:02:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1
Nov 02 05:02:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:02:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:02:47 user nova-compute[75216]: FIRMWARE:
Nov 02 05:02:47 user nova-compute[75216]: No targets found.
Nov 02 05:02:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:02:47 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:02:47 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c946ee-ca35-4b26-949e-f039f1048c23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9fa7f-a417-41ae-9ae4-c4ba3eba8cab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:02:47 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)
Nov 02 05:02:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 (non-flash)
Nov 02 05:02:47 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)
Nov 02 05:02:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec4ebd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1'): ({'sdf'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Removing single pathed devices sdf {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc8d2a-e8c2-43b2-8f98-79b61a16c0b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6de3ce-672d-4607-9483-3a6fff1b734d]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Flushing IO for device /dev/sdf {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a4289b-9b7d-454d-8384-c0a1d673cdeb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b392af1f-b3ab-4caf-bfbd-06665399b2e7]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81534056-bfa6-43b9-976d-5619315919fe]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[908fd918-1585-473f-b099-f9a2fdc2e5ae]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260]
Nov 02 05:02:47 user nova-compute[75216]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1, portal: 172.16.0.220,3260] successful.
Nov 02 05:02:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6dbad-6e4d-4a4d-925b-023e12f174e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3435671-57c8-414f-ad06-c78d8f4b64e4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] <== disconnect_volume: return (315ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:02:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Deleting instance files /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811_del
Nov 02 05:02:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Deletion of /opt/stack/data/nova/instances/43182725-9f83-4afd-a243-49d838e7d811_del complete
Nov 02 05:02:47 user nova-compute[75216]: INFO nova.compute.manager [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 02 05:02:47 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:02:47 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:02:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:02:48 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Took 0.53 seconds to deallocate network for instance.
Nov 02 05:02:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-ea8cebcc-d1b9-4777-9b7b-51ea25721101 req-c4974cf2-e9d7-4ed1-82db-83cc6c185133 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ea8cebcc-d1b9-4777-9b7b-51ea25721101 req-c4974cf2-e9d7-4ed1-82db-83cc6c185133 service nova] Acquiring lock "43182725-9f83-4afd-a243-49d838e7d811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ea8cebcc-d1b9-4777-9b7b-51ea25721101 req-c4974cf2-e9d7-4ed1-82db-83cc6c185133 service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ea8cebcc-d1b9-4777-9b7b-51ea25721101 req-c4974cf2-e9d7-4ed1-82db-83cc6c185133 service nova] Lock "43182725-9f83-4afd-a243-49d838e7d811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-ea8cebcc-d1b9-4777-9b7b-51ea25721101 req-c4974cf2-e9d7-4ed1-82db-83cc6c185133 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] No waiting events found dispatching network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:02:48 user nova-compute[75216]: WARNING nova.compute.manager [req-ea8cebcc-d1b9-4777-9b7b-51ea25721101 req-c4974cf2-e9d7-4ed1-82db-83cc6c185133 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received unexpected event network-vif-plugged-1e2b5f1c-63f6-4ba4-883d-c528768387a4 for instance with vm_state active and task_state deleting.
Nov 02 05:02:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-ea8cebcc-d1b9-4777-9b7b-51ea25721101 req-c4974cf2-e9d7-4ed1-82db-83cc6c185133 service nova] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Received event network-vif-deleted-1e2b5f1c-63f6-4ba4-883d-c528768387a4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:49 user nova-compute[75216]: INFO nova.compute.manager [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 43182725-9f83-4afd-a243-49d838e7d811] Took 1.05 seconds to detach 1 volumes for instance.
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "0428e17f-9755-4632-96f3-fddcf65002a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "0428e17f-9755-4632-96f3-fddcf65002a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:49 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Deleted allocations for instance 43182725-9f83-4afd-a243-49d838e7d811
Nov 02 05:02:49 user nova-compute[75216]: INFO nova.compute.manager [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Terminating instance
Nov 02 05:02:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-577e4907-47be-4cbd-8496-95025ca5b5ea tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "43182725-9f83-4afd-a243-49d838e7d811" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.510s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-fca7ca7f-446d-4293-9b7c-aa7b5149a936 req-561688d6-e11d-4016-a3ce-013c62ddbc35 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received event network-vif-unplugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fca7ca7f-446d-4293-9b7c-aa7b5149a936 req-561688d6-e11d-4016-a3ce-013c62ddbc35 service nova] Acquiring lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fca7ca7f-446d-4293-9b7c-aa7b5149a936 req-561688d6-e11d-4016-a3ce-013c62ddbc35 service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fca7ca7f-446d-4293-9b7c-aa7b5149a936 req-561688d6-e11d-4016-a3ce-013c62ddbc35 service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-fca7ca7f-446d-4293-9b7c-aa7b5149a936 req-561688d6-e11d-4016-a3ce-013c62ddbc35 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] No waiting events found dispatching network-vif-unplugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-fca7ca7f-446d-4293-9b7c-aa7b5149a936 req-561688d6-e11d-4016-a3ce-013c62ddbc35 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received event network-vif-unplugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:02:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Instance destroyed successfully.
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'resources' on Instance uuid 0428e17f-9755-4632-96f3-fddcf65002a1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1916112975',display_name='tempest-TestVolumeBootPattern-server-1916112975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1916112975',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-tp4wbi7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:01:38Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=0428e17f-9755-4632-96f3-fddcf65002a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "address": "fa:16:3e:84:8c:9a", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b140321-a3", "ovs_interfaceid": "1b140321-a34e-45a4-9db2-3ea0ce0117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8c:9a,bridge_name='br-int',has_traffic_filtering=True,id=1b140321-a34e-45a4-9db2-3ea0ce0117ac,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b140321-a3') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_vif [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8c:9a,bridge_name='br-int',has_traffic_filtering=True,id=1b140321-a34e-45a4-9db2-3ea0ce0117ac,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b140321-a3') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b140321-a3, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dafb918-e115-4aeb-9b6c-8b30fa6fa36f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:02:50 user nova-compute[75216]: INFO os_vif [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8c:9a,bridge_name='br-int',has_traffic_filtering=True,id=1b140321-a34e-45a4-9db2-3ea0ce0117ac,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b140321-a3')
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFtVjobl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:02:50 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[027bfa78-1cb6-4f71-9d44-76031bdfe3f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:02:50 user nova-compute[75216]: No targets found.
Nov 02 05:02:50 user nova-compute[75216]: iSNS:
Nov 02 05:02:50 user nova-compute[75216]: No targets found.
Nov 02 05:02:50 user nova-compute[75216]: STATIC:
Nov 02 05:02:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb
Nov 02 05:02:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:02:50 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:02:50 user nova-compute[75216]: FIRMWARE:
Nov 02 05:02:50 user nova-compute[75216]: No targets found.
Nov 02 05:02:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:02:50 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:02:50 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15e9288-1d9d-4331-9da5-f362e8383846]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[569fc3ec-f59b-45c7-8849-4957b0fc5486]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)
Nov 02 05:02:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb (non-flash)
Nov 02 05:02:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460c35d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017112e-9314-4d91-a5fc-479ecf879847]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.157s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45eca5-7b37-4b13-85ef-565cbf342867]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:02:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.100s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a15b35-8281-47e3-bd82-8cccda60db4b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.085s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a972e-dcbb-4a46-a57d-9f81bc419fec]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67013a23-4349-4231-95aa-54c0aa498802]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff810fa-6c66-44e7-a270-f2b6781d6397]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260]
Nov 02 05:02:51 user nova-compute[75216]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb, portal: 172.16.0.220,3260] successful.
Nov 02 05:02:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.compute.claims [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Claim successful on node user
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f56cff-3ec3-4847-9b79-398eb1a489eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[607edf90-77e4-4591-8703-441e43f46262]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.657s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== disconnect_volume: return (658ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Deleting instance files /opt/stack/data/nova/instances/0428e17f-9755-4632-96f3-fddcf65002a1_del
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Deletion of /opt/stack/data/nova/instances/0428e17f-9755-4632-96f3-fddcf65002a1_del complete
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.compute.manager [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Took 1.59 seconds to destroy the instance on the hypervisor.
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.policy [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e3af262ef734b2d8a1b3208e5749fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c9027651a4044a6514c1ab0ec9ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.virt.block_device [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Booting with volume 2025b22e-d7d6-4daf-b58f-3ca28aefe633 at /dev/vda
Nov 02 05:02:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b3eaf-40d6-4b11-b083-e3a1966fc502]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-d4973218-0f0d-4a46-a441-d4f52453c1db req-f620d435-0510-419d-9019-d09e9a828162 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received event network-vif-deleted-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.compute.manager [req-d4973218-0f0d-4a46-a441-d4f52453c1db req-f620d435-0510-419d-9019-d09e9a828162 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Neutron deleted interface 1b140321-a34e-45a4-9db2-3ea0ce0117ac; detaching it from the instance and deleting it from the info cache
Nov 02 05:02:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-d4973218-0f0d-4a46-a441-d4f52453c1db req-f620d435-0510-419d-9019-d09e9a828162 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:02:51 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Took 0.61 seconds to deallocate network for instance.
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6cd5a3-e87c-4397-8f5a-69e3c813c6a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-d4973218-0f0d-4a46-a441-d4f52453c1db req-f620d435-0510-419d-9019-d09e9a828162 service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Detach interface failed, port_id=1b140321-a34e-45a4-9db2-3ea0ce0117ac, reason: Instance 0428e17f-9755-4632-96f3-fddcf65002a1 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe2a02-6cce-4454-81ca-5aaf1e4b4f84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a874cd4-168a-48f2-b691-c026300aa3b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:02:52 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d62ee85-ee9d-4c59-876c-8b1a185e0159]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating existing volume attachment record: 1695acd6-012b-49c6-b4bf-d20ed05e0c45 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-90648245-22bb-4d3a-a410-0ce243425215 req-4959a0c3-9ff0-4666-ac76-516906d4921c service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received event network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90648245-22bb-4d3a-a410-0ce243425215 req-4959a0c3-9ff0-4666-ac76-516906d4921c service nova] Acquiring lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90648245-22bb-4d3a-a410-0ce243425215 req-4959a0c3-9ff0-4666-ac76-516906d4921c service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90648245-22bb-4d3a-a410-0ce243425215 req-4959a0c3-9ff0-4666-ac76-516906d4921c service nova] Lock "0428e17f-9755-4632-96f3-fddcf65002a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-90648245-22bb-4d3a-a410-0ce243425215 req-4959a0c3-9ff0-4666-ac76-516906d4921c service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] No waiting events found dispatching network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:02:52 user nova-compute[75216]: WARNING nova.compute.manager [req-90648245-22bb-4d3a-a410-0ce243425215 req-4959a0c3-9ff0-4666-ac76-516906d4921c service nova] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Received unexpected event network-vif-plugged-1b140321-a34e-45a4-9db2-3ea0ce0117ac for instance with vm_state active and task_state deleting.
Nov 02 05:02:53 user nova-compute[75216]: INFO nova.compute.manager [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Took 1.09 seconds to detach 1 volumes for instance.
Nov 02 05:02:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 0428e17f-9755-4632-96f3-fddcf65002a1] Deleting volume: 82f56cff-3ec3-4847-9b79-398eb1a489eb {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 05:02:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:02:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:02:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Successfully created port: 9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:02:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:02:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:02:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:53 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Deleted allocations for instance 0428e17f-9755-4632-96f3-fddcf65002a1
Nov 02 05:02:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cbb79bd5-6df1-4191-9d34-ba8790ed03fd tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "0428e17f-9755-4632-96f3-fddcf65002a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.886s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Successfully updated port: 9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquired lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Releasing lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance network_info: |[{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-changed-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Refreshing instance network info cache due to event network-changed-9bea3e1d-3045-42bb-ab41-922d00e5f351. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] Acquiring lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] Acquired lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:02:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Refreshing network info cache for port 9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:02:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updated VIF entry in instance network info cache for port 9bea3e1d-3045-42bb-ab41-922d00e5f351. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:02:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:02:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dac68d6-f6ed-460d-b8a4-9f36aa469afd req-ba1758fa-5fa7-4ddd-a140-6e5568fedabb service nova] Releasing lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:02:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:07 user nova-compute[75216]: INFO nova.compute.manager [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Terminating instance
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-03ee32de-5446-49f3-865d-3593af0b68fa req-34afac86-aae6-4169-92dc-64528e889a39 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-vif-unplugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ee32de-5446-49f3-865d-3593af0b68fa req-34afac86-aae6-4169-92dc-64528e889a39 service nova] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ee32de-5446-49f3-865d-3593af0b68fa req-34afac86-aae6-4169-92dc-64528e889a39 service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03ee32de-5446-49f3-865d-3593af0b68fa req-34afac86-aae6-4169-92dc-64528e889a39 service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-03ee32de-5446-49f3-865d-3593af0b68fa req-34afac86-aae6-4169-92dc-64528e889a39 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] No waiting events found dispatching network-vif-unplugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-03ee32de-5446-49f3-865d-3593af0b68fa req-34afac86-aae6-4169-92dc-64528e889a39 service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-vif-unplugged-a7ccfecd-5875-4e4f-9780-15250fd24876 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:03:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Instance destroyed successfully.
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lazy-loading 'resources' on Instance uuid af65cc0f-3880-4df7-8c62-61efbcc110fa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1866729633',display_name='tempest-VolumesSnapshotTestJSON-instance-1866729633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1866729633',id=31,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0CghsnCRqCQ5dJUL2f470G7WiwFcEtwKLwbx8rDrhugToShkpBJRNcWmNYuAHT9SEFG2+VB3jL2o1ptXgXJc2Qf0h7rSF5qANVJbT71zCSNf69QzHSEh5/T4wUA2vo1w==',key_name='tempest-keypair-1925365009',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65b49d78b7cd47db8284e82230b2237f',ramdisk_id='',reservation_id='r-b9g339lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1815478259',owner_user_name='tempest-VolumesSnapshotTestJSON-1815478259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c01f25553f947d781c9c8b8a0953203',uuid=af65cc0f-3880-4df7-8c62-61efbcc110fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converting VIF {"id": "a7ccfecd-5875-4e4f-9780-15250fd24876", "address": "fa:16:3e:a7:84:c6", "network": {"id": "f3aec45f-e5a3-4fbc-8191-0475a8b95db7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1948439157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65b49d78b7cd47db8284e82230b2237f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ccfecd-58", "ovs_interfaceid": "a7ccfecd-5875-4e4f-9780-15250fd24876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:84:c6,bridge_name='br-int',has_traffic_filtering=True,id=a7ccfecd-5875-4e4f-9780-15250fd24876,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ccfecd-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG os_vif [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:84:c6,bridge_name='br-int',has_traffic_filtering=True,id=a7ccfecd-5875-4e4f-9780-15250fd24876,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ccfecd-58') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7ccfecd-58, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a99827d7-4b92-4051-a85e-a2ee53d735a5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:07 user nova-compute[75216]: INFO os_vif [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:84:c6,bridge_name='br-int',has_traffic_filtering=True,id=a7ccfecd-5875-4e4f-9780-15250fd24876,network=Network(f3aec45f-e5a3-4fbc-8191-0475a8b95db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ccfecd-58')
Nov 02 05:03:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Deleting instance files /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa_del
Nov 02 05:03:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Deletion of /opt/stack/data/nova/instances/af65cc0f-3880-4df7-8c62-61efbcc110fa_del complete
Nov 02 05:03:08 user nova-compute[75216]: INFO nova.compute.manager [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 02 05:03:08 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:03:08 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:03:08 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:03:08 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:03:08 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Took 0.70 seconds to deallocate network for instance.
Nov 02 05:03:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-f04950a9-ffe9-466c-ac8d-c537b98c1079 req-6a8bb9c6-8cec-409e-a754-69321418b6ea service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-vif-deleted-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:03:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:03:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:09 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Deleted allocations for instance af65cc0f-3880-4df7-8c62-61efbcc110fa
Nov 02 05:03:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0318579f-b11f-4941-9e3a-113843c33e83 tempest-VolumesSnapshotTestJSON-1815478259 tempest-VolumesSnapshotTestJSON-1815478259-project-member] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-4bad662d-b2de-43ae-9b07-11792d0969cc req-930b392b-b9aa-42e4-b927-ac4f505c3afd service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received event network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bad662d-b2de-43ae-9b07-11792d0969cc req-930b392b-b9aa-42e4-b927-ac4f505c3afd service nova] Acquiring lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bad662d-b2de-43ae-9b07-11792d0969cc req-930b392b-b9aa-42e4-b927-ac4f505c3afd service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bad662d-b2de-43ae-9b07-11792d0969cc req-930b392b-b9aa-42e4-b927-ac4f505c3afd service nova] Lock "af65cc0f-3880-4df7-8c62-61efbcc110fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-4bad662d-b2de-43ae-9b07-11792d0969cc req-930b392b-b9aa-42e4-b927-ac4f505c3afd service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] No waiting events found dispatching network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:09 user nova-compute[75216]: WARNING nova.compute.manager [req-4bad662d-b2de-43ae-9b07-11792d0969cc req-930b392b-b9aa-42e4-b927-ac4f505c3afd service nova] [instance: af65cc0f-3880-4df7-8c62-61efbcc110fa] Received unexpected event network-vif-plugged-a7ccfecd-5875-4e4f-9780-15250fd24876 for instance with vm_state deleted and task_state None.
Nov 02 05:03:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:03:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8304MB free_disk=25.027515411376953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 3b055742-c605-41ab-bd40-1a777b8f4e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 84b9cc72-7fbe-4667-8111-13c61211e055 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e60eecf5-3aca-45c4-8cd5-b577798465c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:03:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Creating image(s)
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e60eecf5-3aca-45c4-8cd5-b577798465c3/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Start _get_guest_xml network_info=[{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1695acd6-012b-49c6-b4bf-d20ed05e0c45', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e60eecf5-3aca-45c4-8cd5-b577798465c3', 'attached_at': '', 'detached_at': '', 'volume_id': '2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'serial': '2025b22e-d7d6-4daf-b58f-3ca28aefe633'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:03:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:03:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:03:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:03:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:03:21 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f29113c-c5ef-4a81-a320-984db09c27cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:03:21 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa80679-5967-4757-b169-7ebd05527c5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633] added
Nov 02 05:03:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3261525e-4e2f-4939-bbb1-5246d6e83059]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d96710-7cfb-428c-a28e-a6e28cee75d9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqmfXAYp {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqmfXAYp" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b50fa3-10fd-44a4-ac38-a41a31573819]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqmfXAYp'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dac0b6-bbb7-4a75-8230-50ed82de3b92]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4af17-550d-45ba-ae08-a0fad0695396]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:03:21 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:03:21 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:03:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 05:03:21 user nova-compute[75216]: 
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84b8d75-ddba-4a0d-90e2-3117763de180]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]
Nov 02 05:03:21 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.
Nov 02 05:03:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b0ad73-c604-464d-b43e-9fb84c852745]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa8462-0a54-4875-bb92-ca54f1191016]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:03:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:03:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "84b9cc72-7fbe-4667-8111-13c61211e055" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "84b9cc72-7fbe-4667-8111-13c61211e055" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:22 user nova-compute[75216]: INFO nova.compute.manager [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Terminating instance
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5740304d-33e7-4cd9-aacf-bf3f72f9c076]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-2810e235-d4d1-410b-961c-8ebef423d09c req-cfd72403-178a-4fd0-94b8-5a7e12b6de42 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received event network-vif-unplugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2810e235-d4d1-410b-961c-8ebef423d09c req-cfd72403-178a-4fd0-94b8-5a7e12b6de42 service nova] Acquiring lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2810e235-d4d1-410b-961c-8ebef423d09c req-cfd72403-178a-4fd0-94b8-5a7e12b6de42 service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2810e235-d4d1-410b-961c-8ebef423d09c req-cfd72403-178a-4fd0-94b8-5a7e12b6de42 service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-2810e235-d4d1-410b-961c-8ebef423d09c req-cfd72403-178a-4fd0-94b8-5a7e12b6de42 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] No waiting events found dispatching network-vif-unplugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-2810e235-d4d1-410b-961c-8ebef423d09c req-cfd72403-178a-4fd0-94b8-5a7e12b6de42 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received event network-vif-unplugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:03:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Instance destroyed successfully.
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lazy-loading 'resources' on Instance uuid 84b9cc72-7fbe-4667-8111-13c61211e055 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1726525375',display_name='tempest-VolumesActionsTest-instance-1726525375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1726525375',id=32,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:01:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='841f9f9b7f2b4a97a646419799d76f5f',ramdisk_id='',reservation_id='r-0e869ro2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1005026844',owner_user_name='tempest-VolumesActionsTest-1005026844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:01:03Z,user_data=None,user_id='50087f7e3cad4995a7a46903ff0f4a7a',uuid=84b9cc72-7fbe-4667-8111-13c61211e055,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Converting VIF {"id": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "address": "fa:16:3e:76:91:2a", "network": {"id": "c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-319875122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "841f9f9b7f2b4a97a646419799d76f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1235ab-0a", "ovs_interfaceid": "7a1235ab-0a41-4a42-ae66-be2f8e0717b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:91:2a,bridge_name='br-int',has_traffic_filtering=True,id=7a1235ab-0a41-4a42-ae66-be2f8e0717b6,network=Network(c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1235ab-0a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG os_vif [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:91:2a,bridge_name='br-int',has_traffic_filtering=True,id=7a1235ab-0a41-4a42-ae66-be2f8e0717b6,network=Network(c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1235ab-0a') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a1235ab-0a, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a6fc1e7-84ff-48a2-857a-f8278be4faac) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:22 user nova-compute[75216]: INFO os_vif [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:91:2a,bridge_name='br-int',has_traffic_filtering=True,id=7a1235ab-0a41-4a42-ae66-be2f8e0717b6,network=Network(c4c3e7b8-8ae9-4990-afa7-6ffbaa3993c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1235ab-0a')
Nov 02 05:03:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Deleting instance files /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055_del
Nov 02 05:03:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Deletion of /opt/stack/data/nova/instances/84b9cc72-7fbe-4667-8111-13c61211e055_del complete
Nov 02 05:03:23 user nova-compute[75216]: INFO nova.compute.manager [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 02 05:03:23 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26234666230326335', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234666230326335', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1065672926',display_name='tempest-ServerActionsTestOtherA-server-1065672926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1065672926',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-jkfxu5rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e60eecf5-3aca-45c4-8cd5-b577798465c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'pci_devices' on Instance uuid e60eecf5-3aca-45c4-8cd5-b577798465c3 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:03:23 user nova-compute[75216]:   <uuid>e60eecf5-3aca-45c4-8cd5-b577798465c3</uuid>
Nov 02 05:03:23 user nova-compute[75216]:   <name>instance-00000023</name>
Nov 02 05:03:23 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:03:23 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:03:23 user nova-compute[75216]:   <metadata>
Nov 02 05:03:23 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:03:23 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:03:23 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-1065672926</nova:name>
Nov 02 05:03:23 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:03:21</nova:creationTime>
Nov 02 05:03:23 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:03:23 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:03:23 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:03:23 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:03:23 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:03:23 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:03:23 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:03:23 user nova-compute[75216]:       <nova:owner>
Nov 02 05:03:23 user nova-compute[75216]:         <nova:user uuid="7e3af262ef734b2d8a1b3208e5749fb3">tempest-ServerActionsTestOtherA-511412938-project-member</nova:user>
Nov 02 05:03:23 user nova-compute[75216]:         <nova:project uuid="597c9027651a4044a6514c1ab0ec9ad8">tempest-ServerActionsTestOtherA-511412938</nova:project>
Nov 02 05:03:23 user nova-compute[75216]:       </nova:owner>
Nov 02 05:03:23 user nova-compute[75216]:       <nova:ports>
Nov 02 05:03:23 user nova-compute[75216]:         <nova:port uuid="9bea3e1d-3045-42bb-ab41-922d00e5f351">
Nov 02 05:03:23 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 05:03:23 user nova-compute[75216]:         </nova:port>
Nov 02 05:03:23 user nova-compute[75216]:       </nova:ports>
Nov 02 05:03:23 user nova-compute[75216]:     </nova:instance>
Nov 02 05:03:23 user nova-compute[75216]:   </metadata>
Nov 02 05:03:23 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:03:23 user nova-compute[75216]:     <system>
Nov 02 05:03:23 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:03:23 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:03:23 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:03:23 user nova-compute[75216]:       <entry name="serial">e60eecf5-3aca-45c4-8cd5-b577798465c3</entry>
Nov 02 05:03:23 user nova-compute[75216]:       <entry name="uuid">e60eecf5-3aca-45c4-8cd5-b577798465c3</entry>
Nov 02 05:03:23 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:03:23 user nova-compute[75216]:     </system>
Nov 02 05:03:23 user nova-compute[75216]:   </sysinfo>
Nov 02 05:03:23 user nova-compute[75216]:   <os>
Nov 02 05:03:23 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:03:23 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:03:23 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:03:23 user nova-compute[75216]:   </os>
Nov 02 05:03:23 user nova-compute[75216]:   <features>
Nov 02 05:03:23 user nova-compute[75216]:     <acpi/>
Nov 02 05:03:23 user nova-compute[75216]:     <apic/>
Nov 02 05:03:23 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:03:23 user nova-compute[75216]:   </features>
Nov 02 05:03:23 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:03:23 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:03:23 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:03:23 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:03:23 user nova-compute[75216]:   </clock>
Nov 02 05:03:23 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:03:23 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:03:23 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:03:23 user nova-compute[75216]:   </cpu>
Nov 02 05:03:23 user nova-compute[75216]:   <devices>
Nov 02 05:03:23 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:03:23 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:03:23 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 05:03:23 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:03:23 user nova-compute[75216]:       <serial>2025b22e-d7d6-4daf-b58f-3ca28aefe633</serial>
Nov 02 05:03:23 user nova-compute[75216]:     </disk>
Nov 02 05:03:23 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:03:23 user nova-compute[75216]:       <mac address="fa:16:3e:7e:19:49"/>
Nov 02 05:03:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:03:23 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:03:23 user nova-compute[75216]:       <target dev="tap9bea3e1d-30"/>
Nov 02 05:03:23 user nova-compute[75216]:     </interface>
Nov 02 05:03:23 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:03:23 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/e60eecf5-3aca-45c4-8cd5-b577798465c3/console.log" append="off"/>
Nov 02 05:03:23 user nova-compute[75216]:     </serial>
Nov 02 05:03:23 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:03:23 user nova-compute[75216]:     <video>
Nov 02 05:03:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:03:23 user nova-compute[75216]:     </video>
Nov 02 05:03:23 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:03:23 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:03:23 user nova-compute[75216]:     </rng>
Nov 02 05:03:23 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:03:23 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:03:23 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:03:23 user nova-compute[75216]:     </memballoon>
Nov 02 05:03:23 user nova-compute[75216]:   </devices>
Nov 02 05:03:23 user nova-compute[75216]: </domain>
Nov 02 05:03:23 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1065672926',display_name='tempest-ServerActionsTestOtherA-server-1065672926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1065672926',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-jkfxu5rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e60eecf5-3aca-45c4-8cd5-b577798465c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG os_vif [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf902e30-f0d9-5742-8d74-af4a617e731c', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bea3e1d-30, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bea3e1d-30, col_values=(('qos', UUID('6f926d5c-e6d4-4273-8fce-b86e1483d759')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bea3e1d-30, col_values=(('external_ids', {'iface-id': '9bea3e1d-3045-42bb-ab41-922d00e5f351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:19:49', 'vm-uuid': 'e60eecf5-3aca-45c4-8cd5-b577798465c3'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:23 user nova-compute[75216]: INFO os_vif [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30')
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No VIF found with MAC fa:16:3e:7e:19:49, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:03:23 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Took 0.76 seconds to deallocate network for instance.
Nov 02 05:03:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-461a2176-49a0-4e7c-9a2e-0571a25b7909 req-ce51be79-ad78-4e14-8771-c6d6e21f6f44 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received event network-vif-deleted-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:24 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Deleted allocations for instance 84b9cc72-7fbe-4667-8111-13c61211e055
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125d1f51-3728-48c2-8582-ffcd0eb9fbd3 tempest-VolumesActionsTest-1005026844 tempest-VolumesActionsTest-1005026844-project-member] Lock "84b9cc72-7fbe-4667-8111-13c61211e055" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-5d46c081-603b-4d42-ad48-29552b3a133c req-15e685d1-789c-48f5-ba3e-726462295ef5 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received event network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5d46c081-603b-4d42-ad48-29552b3a133c req-15e685d1-789c-48f5-ba3e-726462295ef5 service nova] Acquiring lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5d46c081-603b-4d42-ad48-29552b3a133c req-15e685d1-789c-48f5-ba3e-726462295ef5 service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5d46c081-603b-4d42-ad48-29552b3a133c req-15e685d1-789c-48f5-ba3e-726462295ef5 service nova] Lock "84b9cc72-7fbe-4667-8111-13c61211e055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-5d46c081-603b-4d42-ad48-29552b3a133c req-15e685d1-789c-48f5-ba3e-726462295ef5 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] No waiting events found dispatching network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:24 user nova-compute[75216]: WARNING nova.compute.manager [req-5d46c081-603b-4d42-ad48-29552b3a133c req-15e685d1-789c-48f5-ba3e-726462295ef5 service nova] [instance: 84b9cc72-7fbe-4667-8111-13c61211e055] Received unexpected event network-vif-plugged-7a1235ab-0a41-4a42-ae66-be2f8e0717b6 for instance with vm_state deleted and task_state None.
Nov 02 05:03:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-42b10289-e77b-446e-9ec8-9452c9c94f95 req-1e728bc9-b9d8-49dd-97df-78b789f386e5 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-42b10289-e77b-446e-9ec8-9452c9c94f95 req-1e728bc9-b9d8-49dd-97df-78b789f386e5 service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-42b10289-e77b-446e-9ec8-9452c9c94f95 req-1e728bc9-b9d8-49dd-97df-78b789f386e5 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-42b10289-e77b-446e-9ec8-9452c9c94f95 req-1e728bc9-b9d8-49dd-97df-78b789f386e5 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-42b10289-e77b-446e-9ec8-9452c9c94f95 req-1e728bc9-b9d8-49dd-97df-78b789f386e5 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:24 user nova-compute[75216]: WARNING nova.compute.manager [req-42b10289-e77b-446e-9ec8-9452c9c94f95 req-1e728bc9-b9d8-49dd-97df-78b789f386e5 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received unexpected event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with vm_state building and task_state spawning.
Nov 02 05:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6b3e76f-3810-4334-9d52-d96af52f8175 req-b3d050f6-faa9-4f8a-9ab6-4c851b4630f8 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6b3e76f-3810-4334-9d52-d96af52f8175 req-b3d050f6-faa9-4f8a-9ab6-4c851b4630f8 service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6b3e76f-3810-4334-9d52-d96af52f8175 req-b3d050f6-faa9-4f8a-9ab6-4c851b4630f8 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6b3e76f-3810-4334-9d52-d96af52f8175 req-b3d050f6-faa9-4f8a-9ab6-4c851b4630f8 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6b3e76f-3810-4334-9d52-d96af52f8175 req-b3d050f6-faa9-4f8a-9ab6-4c851b4630f8 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:27 user nova-compute[75216]: WARNING nova.compute.manager [req-e6b3e76f-3810-4334-9d52-d96af52f8175 req-b3d050f6-faa9-4f8a-9ab6-4c851b4630f8 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received unexpected event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with vm_state building and task_state spawning.
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:03:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance spawned successfully.
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:03:27 user nova-compute[75216]: INFO nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 02 05:03:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:03:27 user nova-compute[75216]: INFO nova.compute.manager [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Took 36.10 seconds to build instance.
Nov 02 05:03:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea663749-c73d-414a-9ac5-3bd76f75f4a4 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.713s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing instance network info cache due to event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] Acquiring lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] Acquired lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updated VIF entry in instance network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:03:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-69676b7e-0812-4260-868b-4d84ec317fe7 req-9dd69948-4340-412a-8cd2-0d59a298383c service nova] Releasing lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:03:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:37 user nova-compute[75216]: INFO nova.compute.manager [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Terminating instance
Nov 02 05:03:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:37 user nova-compute[75216]: INFO nova.compute.manager [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Shelving
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-c9f8d51a-6a7a-4cba-a5f0-655f86984b72 req-9989fb2c-1905-4af7-986b-4eda0be6d0b3 service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received event network-vif-unplugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c9f8d51a-6a7a-4cba-a5f0-655f86984b72 req-9989fb2c-1905-4af7-986b-4eda0be6d0b3 service nova] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c9f8d51a-6a7a-4cba-a5f0-655f86984b72 req-9989fb2c-1905-4af7-986b-4eda0be6d0b3 service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c9f8d51a-6a7a-4cba-a5f0-655f86984b72 req-9989fb2c-1905-4af7-986b-4eda0be6d0b3 service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-c9f8d51a-6a7a-4cba-a5f0-655f86984b72 req-9989fb2c-1905-4af7-986b-4eda0be6d0b3 service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] No waiting events found dispatching network-vif-unplugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-c9f8d51a-6a7a-4cba-a5f0-655f86984b72 req-9989fb2c-1905-4af7-986b-4eda0be6d0b3 service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received event network-vif-unplugged-65c3201b-92ac-4811-8425-8b6139848766 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance destroyed successfully.
Nov 02 05:03:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Instance destroyed successfully.
Nov 02 05:03:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lazy-loading 'resources' on Instance uuid 3b055742-c605-41ab-bd40-1a777b8f4e39 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-821388551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-821388551',id=2,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:43:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6771c51304d446b8338d0d879ede48f',ramdisk_id='',reservation_id='r-d2l1urr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:45:01Z,user_data=None,user_id='ae71d7b88da2452a9ec4489a0ef49176',uuid=3b055742-c605-41ab-bd40-1a777b8f4e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converting VIF {"id": "65c3201b-92ac-4811-8425-8b6139848766", "address": "fa:16:3e:9e:5a:a5", "network": {"id": "e6802b40-67b3-483f-a479-5a4a42bef4ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1514716157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6771c51304d446b8338d0d879ede48f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c3201b-92", "ovs_interfaceid": "65c3201b-92ac-4811-8425-8b6139848766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5a:a5,bridge_name='br-int',has_traffic_filtering=True,id=65c3201b-92ac-4811-8425-8b6139848766,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c3201b-92') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG os_vif [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5a:a5,bridge_name='br-int',has_traffic_filtering=True,id=65c3201b-92ac-4811-8425-8b6139848766,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c3201b-92') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65c3201b-92, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Beginning cold snapshot process
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=232f4615-a25d-4234-afed-76d611add699) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:38 user nova-compute[75216]: INFO os_vif [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5a:a5,bridge_name='br-int',has_traffic_filtering=True,id=65c3201b-92ac-4811-8425-8b6139848766,network=Network(e6802b40-67b3-483f-a479-5a4a42bef4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c3201b-92')
Nov 02 05:03:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Deleting instance files /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39_del
Nov 02 05:03:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Deletion of /opt/stack/data/nova/instances/3b055742-c605-41ab-bd40-1a777b8f4e39_del complete
Nov 02 05:03:38 user nova-compute[75216]: INFO nova.compute.manager [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 02 05:03:38 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 05:03:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk /opt/stack/data/nova/instances/snapshots/tmpta5vvt40/1a7094b4103f49edb2796538f7146565 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received event network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Acquiring lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] No waiting events found dispatching network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:39 user nova-compute[75216]: WARNING nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received unexpected event network-vif-plugged-65c3201b-92ac-4811-8425-8b6139848766 for instance with vm_state active and task_state deleting.
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:39 user nova-compute[75216]: WARNING nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:39 user nova-compute[75216]: WARNING nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:39 user nova-compute[75216]: WARNING nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:39 user nova-compute[75216]: WARNING nova.compute.manager [req-a5d38428-63b7-4ba2-a024-4da0f9e08459 req-3a6b3996-1c98-4643-a302-f0642e6551b7 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 02 05:03:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk /opt/stack/data/nova/instances/snapshots/tmpta5vvt40/1a7094b4103f49edb2796538f7146565" returned: 0 in 1.110s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:03:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Snapshot extracted, beginning image upload
Nov 02 05:03:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:40 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:03:40 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Took 1.34 seconds to deallocate network for instance.
Nov 02 05:03:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:03:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:03:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:40 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Deleted allocations for instance 3b055742-c605-41ab-bd40-1a777b8f4e39
Nov 02 05:03:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-15bce450-6ed5-445f-86e0-e05da70bffc0 tempest-ServerBootFromVolumeStableRescueTest-1501080447 tempest-ServerBootFromVolumeStableRescueTest-1501080447-project-member] Lock "3b055742-c605-41ab-bd40-1a777b8f4e39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] [instance: 3b055742-c605-41ab-bd40-1a777b8f4e39] Received event network-vif-deleted-65c3201b-92ac-4811-8425-8b6139848766 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:41 user nova-compute[75216]: WARNING nova.compute.manager [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 05:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:03:41 user nova-compute[75216]: WARNING nova.compute.manager [req-dee66e02-14ed-44f0-bcfe-b63e690dcf3c req-56ec4976-0514-423c-b867-2aa13822c8e2 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 05:03:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Snapshot image upload complete
Nov 02 05:03:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:03:42 user nova-compute[75216]: INFO nova.compute.manager [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Shelve offloading
Nov 02 05:03:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance destroyed successfully.
Nov 02 05:03:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:03:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:03:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquired lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:03:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:03:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:03:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Releasing lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:03:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance destroyed successfully.
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'resources' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2088799543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2088799543',id=34,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp/OO6sRIUyd7lJWqOohJY7Okmd7HecjmvgLRJ/CmJZ/1xScmDAxFb8TwNkKtAm4mJGJ1O5rTfrxPxdMxXi5fWjnWXo8KDBv6eTtt8Ksivq3jY1j1FW4P3f3pJuj2mLfQ==',key_name='tempest-keypair-117377760',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-sm1vnak4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member',shelved_at='2023-11-02T05:03:42.830396',shelved_host='user',shelved_image_id='baa01244-0229-4a33-81a2-062df47306a9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=bcd6130f-c66d-4e4c-80f8-e61d59f662f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG os_vif [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57f48792-35, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing instance network info cache due to event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] Acquiring lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] Acquired lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b00e3968-00a5-4adb-ad00-36c802ae13b9) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:03:44 user nova-compute[75216]: INFO os_vif [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35')
Nov 02 05:03:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Deleting instance files /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1_del
Nov 02 05:03:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Deletion of /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1_del complete
Nov 02 05:03:44 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Deleted allocations for instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1
Nov 02 05:03:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'numa_topology' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.objects.base [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<bcd6130f-c66d-4e4c-80f8-e61d59f662f1> lazy-loaded attributes: resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-efae8385-a5f0-4a81-bf46-61461b4f0219 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.968s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updated VIF entry in instance network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap57f48792-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:03:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2435e0a9-d9d1-4c72-b27e-d84ce29b6991 req-254fe7fb-646f-4f74-96cb-459fd8e2ffdc service nova] Releasing lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:03:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:03:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:04:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:04:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:04:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:04:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:04:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8525MB free_disk=25.15401840209961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e60eecf5-3aca-45c4-8cd5-b577798465c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:04:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:04:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:04:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "1a50d6b8-242a-485a-9f1c-d3026bad949b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:04:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:04:23 user nova-compute[75216]: INFO nova.compute.claims [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Claim successful on node user
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:04:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:04:24 user nova-compute[75216]: INFO nova.virt.block_device [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Booting with volume 550e00de-1677-4bca-bd91-6de138b64816 at /dev/vda
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.policy [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94f0b01ce0c744bdbb937e0a477dcf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eeaefe9a0e4468d9bbb99ba3aca7c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG os_brick.utils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a281936-5689-4268-a603-e02ed96b5fae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[600d393f-a41d-4a27-8dea-ba377028a2b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a84ebe6-538a-438e-a846-8279c8e4a820]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fd3d80-d1ff-43c2-8680-a5a21c345a27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:04:24 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:04:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f41225e-cbac-479b-ab1f-41e952ad2517]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG os_brick.utils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:04:24 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updating existing volume attachment record: 91626bf0-908b-46e4-895e-2b4889ba186d {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:04:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Successfully created port: 31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Successfully updated port: 31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquired lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-changed-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Refreshing instance network info cache due to event network-changed-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] Acquiring lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updating instance_info_cache with network_info: [{"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Releasing lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Instance network_info: |[{"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] Acquired lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:04:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Refreshing network info cache for port 31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:04:27 user nova-compute[75216]: DEBUG nova.network.neutron [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updated VIF entry in instance network info cache for port 31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:04:27 user nova-compute[75216]: DEBUG nova.network.neutron [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updating instance_info_cache with network_info: [{"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:04:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-50c25b7d-6647-45fe-a837-571691d99e7c req-9285f9a3-077f-41ba-87cc-0cab7f5c7337 service nova] Releasing lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:04:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:04:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:04:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:04:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-changed-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:04:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Refreshing instance network info cache due to event network-changed-0fa57ac7-5baf-476a-b5be-44a9e834d05f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:04:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:04:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:04:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Refreshing network info cache for port 0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:04:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updated VIF entry in instance network info cache for port 0fa57ac7-5baf-476a-b5be-44a9e834d05f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:04:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:04:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d1a03048-038a-4c3d-9c79-38bd4bf5808f req-75dc488c-8a31-4ad6-96ad-d9aaf6e87986 service nova] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-changed-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Refreshing instance network info cache due to event network-changed-9bea3e1d-3045-42bb-ab41-922d00e5f351. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] Acquiring lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] Acquired lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:04:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Refreshing network info cache for port 9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Stashing vm_state: active {{(pid=75216) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updated VIF entry in instance network info cache for port 9bea3e1d-3045-42bb-ab41-922d00e5f351. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85facd39-91be-432b-9d01-8ab7bb59250d req-11b16b07-cd7c-4a4a-85fe-91c48a6d1879 service nova] Releasing lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:04:45 user nova-compute[75216]: INFO nova.compute.claims [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Claim successful on node user
Nov 02 05:04:45 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating resource usage from migration be6e4a35-506a-4c05-8506-99d8d34d528a
Nov 02 05:04:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.292s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:04:45 user nova-compute[75216]: INFO nova.compute.manager [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Migrating
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:04:45 user nova-compute[75216]: INFO nova.compute.rpcapi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquired lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:04:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Releasing lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Starting migrate_disk_and_power_off {{(pid=75216) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-057634ad-012d-413d-934c-f279644bee10 req-9440888c-eb8c-4282-ad02-49469e3c4220 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-unplugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-057634ad-012d-413d-934c-f279644bee10 req-9440888c-eb8c-4282-ad02-49469e3c4220 service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-057634ad-012d-413d-934c-f279644bee10 req-9440888c-eb8c-4282-ad02-49469e3c4220 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-057634ad-012d-413d-934c-f279644bee10 req-9440888c-eb8c-4282-ad02-49469e3c4220 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:04:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-057634ad-012d-413d-934c-f279644bee10 req-9440888c-eb8c-4282-ad02-49469e3c4220 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-unplugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:04:46 user nova-compute[75216]: WARNING nova.compute.manager [req-057634ad-012d-413d-934c-f279644bee10 req-9440888c-eb8c-4282-ad02-49469e3c4220 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received unexpected event network-vif-unplugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with vm_state active and task_state resize_migrating.
Nov 02 05:04:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance destroyed successfully.
Nov 02 05:04:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1065672926',display_name='tempest-ServerActionsTestOtherA-server-1065672926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1065672926',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:03:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-jkfxu5rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e60eecf5-3aca-45c4-8cd5-b577798465c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1956484114-network", "vif_mac": "fa:16:3e:7e:19:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1956484114-network", "vif_mac": "fa:16:3e:7e:19:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_vif [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bea3e1d-30, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f926d5c-e6d4-4273-8fce-b86e1483d759) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:04:47 user nova-compute[75216]: INFO os_vif [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30')
Nov 02 05:04:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:04:47 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea58c0f-ce01-4b16-a507-2e722926a920]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:04:47 user nova-compute[75216]: No targets found.
Nov 02 05:04:47 user nova-compute[75216]: iSNS:
Nov 02 05:04:47 user nova-compute[75216]: No targets found.
Nov 02 05:04:47 user nova-compute[75216]: STATIC:
Nov 02 05:04:47 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633
Nov 02 05:04:47 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:04:47 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:04:47 user nova-compute[75216]: FIRMWARE:
Nov 02 05:04:47 user nova-compute[75216]: No targets found.
Nov 02 05:04:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:04:47 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:04:47 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b098dd88-1d5e-4b29-bf17-062f3bd0fe2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e468ad1-aac2-4a49-912a-46ebd2d4a1eb]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:04:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:04:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec473a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146a3cc-b9dc-47ed-b3e4-639f5d248c80]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ceea59-88d8-4f9f-a076-a6be2425ddec]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b39296-499d-4469-8a45-084621bb7fb8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5065e16-fd30-472a-8569-8054955c2dc7]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfc359a66-b4fb02c536056816', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fc359a66', '/dev/disk/by-id/scsi-26234666230326335') {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a72ff-3547-4887-b664-ab5d33b8db84]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[78901ecc-8ad6-412a-b824-8b918c7c6a17]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae924089-90e9-4119-a08f-ca3f51684591]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]
Nov 02 05:04:47 user nova-compute[75216]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.
Nov 02 05:04:47 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[110e9532-9c54-45a3-a84c-f2c711b113a3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== disconnect_volume: return (314ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:04:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:04:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Port 9bea3e1d-3045-42bb-ab41-922d00e5f351 binding to destination host user is already ACTIVE {{(pid=75216) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-3b7d3456-7374-46e0-96dd-759e3ee50852 req-e7cffba7-5d79-4ac4-a084-cc649cd0da3e service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3b7d3456-7374-46e0-96dd-759e3ee50852 req-e7cffba7-5d79-4ac4-a084-cc649cd0da3e service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3b7d3456-7374-46e0-96dd-759e3ee50852 req-e7cffba7-5d79-4ac4-a084-cc649cd0da3e service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3b7d3456-7374-46e0-96dd-759e3ee50852 req-e7cffba7-5d79-4ac4-a084-cc649cd0da3e service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-3b7d3456-7374-46e0-96dd-759e3ee50852 req-e7cffba7-5d79-4ac4-a084-cc649cd0da3e service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:04:49 user nova-compute[75216]: WARNING nova.compute.manager [req-3b7d3456-7374-46e0-96dd-759e3ee50852 req-e7cffba7-5d79-4ac4-a084-cc649cd0da3e service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received unexpected event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with vm_state active and task_state resize_migrated.
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquired lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Releasing lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG os_brick.utils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:04:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b077f2-c8f7-497d-bca6-7342b9330b80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cdea2b-365d-47d6-adb1-e4a30ea59536]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e380813-1e34-4d12-855c-b910ccf505e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b660328-5ffd-4d44-987f-94fc5a896e4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:04:50 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:04:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4d2a2-f2e0-4f9d-b874-edc20347177c]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:04:50 user nova-compute[75216]: DEBUG os_brick.utils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:04:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:04:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Starting finish_migration {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 05:05:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Creating image(s)
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e60eecf5-3aca-45c4-8cd5-b577798465c3/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Start _get_guest_xml network_info=[{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1956484114-network", "vif_mac": "fa:16:3e:7e:19:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '55411b04-69f4-4141-a8f1-ee2563f6e40b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e60eecf5-3aca-45c4-8cd5-b577798465c3', 'attached_at': '2023-11-02T05:05:10.000000', 'detached_at': '', 'volume_id': '2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'serial': '2025b22e-d7d6-4daf-b58f-3ca28aefe633'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:05:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:05:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:05:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:05:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:05:09 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f267baa-279f-4698-a4ac-f32d544830b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:05:09 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d289624-3e6c-4dc8-bb8e-0a17cde06d67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633] added
Nov 02 05:05:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca27c30-bef5-4a13-8f91-af3455db246e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c05ba5-3fa5-46c3-afa5-d71038ff4618]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqmfXAYp {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqmfXAYp" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[55416b6a-06b8-49b5-9086-4113b0c408f2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqmfXAYp'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53db4ae-8f3e-42f9-adc8-923adb9008b2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5213fa2f-470c-4f27-a40e-7cf84a072209]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:05:09 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:05:09 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:05:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 05:05:09 user nova-compute[75216]: 
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3231cfb-9692-444c-bbfc-96620278686e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]
Nov 02 05:05:09 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.
Nov 02 05:05:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1689c981-2037-44dd-ba15-16e87f42bb3c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1a2277-f835-446b-a69a-6f62ce702b10]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:05:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:05:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7a2bc9-3427-4afc-80d9-06ed4c784563]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26234666230326335', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234666230326335', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1065672926',display_name='tempest-ServerActionsTestOtherA-server-1065672926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1065672926',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:03:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-jkfxu5rl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e60eecf5-3aca-45c4-8cd5-b577798465c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1956484114-network", "vif_mac": "fa:16:3e:7e:19:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1956484114-network", "vif_mac": "fa:16:3e:7e:19:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:05:11 user nova-compute[75216]:   <uuid>e60eecf5-3aca-45c4-8cd5-b577798465c3</uuid>
Nov 02 05:05:11 user nova-compute[75216]:   <name>instance-00000023</name>
Nov 02 05:05:11 user nova-compute[75216]:   <memory>2097152</memory>
Nov 02 05:05:11 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:05:11 user nova-compute[75216]:   <metadata>
Nov 02 05:05:11 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:05:11 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:05:11 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-1065672926</nova:name>
Nov 02 05:05:11 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:05:09</nova:creationTime>
Nov 02 05:05:11 user nova-compute[75216]:       <nova:flavor name="m1.small">
Nov 02 05:05:11 user nova-compute[75216]:         <nova:memory>2048</nova:memory>
Nov 02 05:05:11 user nova-compute[75216]:         <nova:disk>20</nova:disk>
Nov 02 05:05:11 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:05:11 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:05:11 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:05:11 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:05:11 user nova-compute[75216]:       <nova:owner>
Nov 02 05:05:11 user nova-compute[75216]:         <nova:user uuid="7e3af262ef734b2d8a1b3208e5749fb3">tempest-ServerActionsTestOtherA-511412938-project-member</nova:user>
Nov 02 05:05:11 user nova-compute[75216]:         <nova:project uuid="597c9027651a4044a6514c1ab0ec9ad8">tempest-ServerActionsTestOtherA-511412938</nova:project>
Nov 02 05:05:11 user nova-compute[75216]:       </nova:owner>
Nov 02 05:05:11 user nova-compute[75216]:       <nova:ports>
Nov 02 05:05:11 user nova-compute[75216]:         <nova:port uuid="9bea3e1d-3045-42bb-ab41-922d00e5f351">
Nov 02 05:05:11 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 05:05:11 user nova-compute[75216]:         </nova:port>
Nov 02 05:05:11 user nova-compute[75216]:       </nova:ports>
Nov 02 05:05:11 user nova-compute[75216]:     </nova:instance>
Nov 02 05:05:11 user nova-compute[75216]:   </metadata>
Nov 02 05:05:11 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:05:11 user nova-compute[75216]:     <system>
Nov 02 05:05:11 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:05:11 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:05:11 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:05:11 user nova-compute[75216]:       <entry name="serial">e60eecf5-3aca-45c4-8cd5-b577798465c3</entry>
Nov 02 05:05:11 user nova-compute[75216]:       <entry name="uuid">e60eecf5-3aca-45c4-8cd5-b577798465c3</entry>
Nov 02 05:05:11 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:05:11 user nova-compute[75216]:     </system>
Nov 02 05:05:11 user nova-compute[75216]:   </sysinfo>
Nov 02 05:05:11 user nova-compute[75216]:   <os>
Nov 02 05:05:11 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:05:11 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:05:11 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:05:11 user nova-compute[75216]:   </os>
Nov 02 05:05:11 user nova-compute[75216]:   <features>
Nov 02 05:05:11 user nova-compute[75216]:     <acpi/>
Nov 02 05:05:11 user nova-compute[75216]:     <apic/>
Nov 02 05:05:11 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:05:11 user nova-compute[75216]:   </features>
Nov 02 05:05:11 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:05:11 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:05:11 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:05:11 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:05:11 user nova-compute[75216]:   </clock>
Nov 02 05:05:11 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:05:11 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:05:11 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:05:11 user nova-compute[75216]:   </cpu>
Nov 02 05:05:11 user nova-compute[75216]:   <devices>
Nov 02 05:05:11 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:05:11 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:05:11 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 05:05:11 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:05:11 user nova-compute[75216]:       <serial>2025b22e-d7d6-4daf-b58f-3ca28aefe633</serial>
Nov 02 05:05:11 user nova-compute[75216]:     </disk>
Nov 02 05:05:11 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:05:11 user nova-compute[75216]:       <mac address="fa:16:3e:7e:19:49"/>
Nov 02 05:05:11 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:05:11 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:05:11 user nova-compute[75216]:       <target dev="tap9bea3e1d-30"/>
Nov 02 05:05:11 user nova-compute[75216]:     </interface>
Nov 02 05:05:11 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:05:11 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/e60eecf5-3aca-45c4-8cd5-b577798465c3/console.log" append="off"/>
Nov 02 05:05:11 user nova-compute[75216]:     </serial>
Nov 02 05:05:11 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:05:11 user nova-compute[75216]:     <video>
Nov 02 05:05:11 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:05:11 user nova-compute[75216]:     </video>
Nov 02 05:05:11 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:05:11 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:05:11 user nova-compute[75216]:     </rng>
Nov 02 05:05:11 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:05:11 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:05:11 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:05:11 user nova-compute[75216]:     </memballoon>
Nov 02 05:05:11 user nova-compute[75216]:   </devices>
Nov 02 05:05:11 user nova-compute[75216]: </domain>
Nov 02 05:05:11 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1065672926',display_name='tempest-ServerActionsTestOtherA-server-1065672926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1065672926',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:03:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-jkfxu5rl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e60eecf5-3aca-45c4-8cd5-b577798465c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1956484114-network", "vif_mac": "fa:16:3e:7e:19:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1956484114-network", "vif_mac": "fa:16:3e:7e:19:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG os_vif [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf902e30-f0d9-5742-8d74-af4a617e731c', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bea3e1d-30, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bea3e1d-30, col_values=(('qos', UUID('89d0cbcc-2f54-4787-b2b6-d2fad97c21ae')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bea3e1d-30, col_values=(('external_ids', {'iface-id': '9bea3e1d-3045-42bb-ab41-922d00e5f351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:19:49', 'vm-uuid': 'e60eecf5-3aca-45c4-8cd5-b577798465c3'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:11 user nova-compute[75216]: INFO os_vif [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30')
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:05:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] No VIF found with MAC fa:16:3e:7e:19:49, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-05d5a8c6-b03d-4407-aca0-d441e66fe9d0 req-128a6a28-1389-4f5d-b634-82c026eb878d service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05d5a8c6-b03d-4407-aca0-d441e66fe9d0 req-128a6a28-1389-4f5d-b634-82c026eb878d service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05d5a8c6-b03d-4407-aca0-d441e66fe9d0 req-128a6a28-1389-4f5d-b634-82c026eb878d service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05d5a8c6-b03d-4407-aca0-d441e66fe9d0 req-128a6a28-1389-4f5d-b634-82c026eb878d service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-05d5a8c6-b03d-4407-aca0-d441e66fe9d0 req-128a6a28-1389-4f5d-b634-82c026eb878d service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:05:12 user nova-compute[75216]: WARNING nova.compute.manager [req-05d5a8c6-b03d-4407-aca0-d441e66fe9d0 req-128a6a28-1389-4f5d-b634-82c026eb878d service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received unexpected event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with vm_state active and task_state resize_finish.
Nov 02 05:05:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-d026ca9d-b68b-455d-bf55-9a9024dced6e req-b76b54f5-2d9d-4484-b3ff-7f8393209271 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:05:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d026ca9d-b68b-455d-bf55-9a9024dced6e req-b76b54f5-2d9d-4484-b3ff-7f8393209271 service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d026ca9d-b68b-455d-bf55-9a9024dced6e req-b76b54f5-2d9d-4484-b3ff-7f8393209271 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d026ca9d-b68b-455d-bf55-9a9024dced6e req-b76b54f5-2d9d-4484-b3ff-7f8393209271 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-d026ca9d-b68b-455d-bf55-9a9024dced6e req-b76b54f5-2d9d-4484-b3ff-7f8393209271 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:05:14 user nova-compute[75216]: WARNING nova.compute.manager [req-d026ca9d-b68b-455d-bf55-9a9024dced6e req-b76b54f5-2d9d-4484-b3ff-7f8393209271 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received unexpected event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with vm_state active and task_state resize_finish.
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:05:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance running successfully.
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Failed to set time: agent not configured {{(pid=75216) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c4115439-e0a3-4357-82e2-a30bab5fecb5 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] finish_migration finished successfully. {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:05:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Creating image(s)
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Ensure instance console log exists: /opt/stack/data/nova/instances/1a50d6b8-242a-485a-9f1c-d3026bad949b/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Start _get_guest_xml network_info=[{"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '91626bf0-908b-46e4-895e-2b4889ba186d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyIjuaot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a50d6b8-242a-485a-9f1c-d3026bad949b', 'attached_at': '', 'detached_at': '', 'volume_id': '550e00de-1677-4bca-bd91-6de138b64816', 'serial': '550e00de-1677-4bca-bd91-6de138b64816'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:05:15 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:05:15 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyIjuaot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:05:15 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:05:15 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:05:15 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e2afcb-4d7b-4f14-b83a-c2b419134ff1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:05:15 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd533c2-ab8b-4d85-a04d-0916c10e3666]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816] added
Nov 02 05:05:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca1d3e8-eb09-4f49-80a4-36de51c821d8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd94445e-8b3d-44e7-b1b2-a7e0458b6235]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RyIjuaot {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RyIjuaot" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[449d0c00-1271-4272-a175-3cf4c66cbbd0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RyIjuaot'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d37d50-a86b-4657-b7d0-14486183173e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b55e9a-a091-4f17-93a9-248a8e7e9893]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:05:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:05:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ac3820-b44e-478f-b53e-42e00c929b2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260]
Nov 02 05:05:15 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260] successful.
Nov 02 05:05:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0327e1-dd19-4994-8226-697d32519b66]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddeab7d-78ff-4c3a-98a0-4b1af9d3448b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:05:15 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:05:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:05:15 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:05:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[893aa77b-ea75-4b97-a5de-3548828d4277]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:05:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyIjuaot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26163313364623134', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163313364623134', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-722897594',display_name='tempest-TestVolumeBootPattern-volume-backed-server-722897594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-722897594',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPHR6cuXfP45cr+9JuBshhxqoGTl2O3mAVMlY/qgyxq0pkxiusWrcsRFUllkwsaA3M83DOUF3k9x9WDrUgNTUy0hb6w8RY77+2xR2uKfcwUG3Q9vrYYSUJ7djZ6kvaS+Q==',key_name='tempest-keypair-483486078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-h3uajbrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=1a50d6b8-242a-485a-9f1c-d3026bad949b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:92:67,bridge_name='br-int',has_traffic_filtering=True,id=31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ae12cb-24') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.objects.instance [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a50d6b8-242a-485a-9f1c-d3026bad949b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:05:16 user nova-compute[75216]:   <uuid>1a50d6b8-242a-485a-9f1c-d3026bad949b</uuid>
Nov 02 05:05:16 user nova-compute[75216]:   <name>instance-00000024</name>
Nov 02 05:05:16 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:05:16 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:05:16 user nova-compute[75216]:   <metadata>
Nov 02 05:05:16 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:05:16 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:05:16 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-722897594</nova:name>
Nov 02 05:05:16 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:05:15</nova:creationTime>
Nov 02 05:05:16 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:05:16 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:05:16 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:05:16 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:05:16 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:05:16 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:05:16 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:05:16 user nova-compute[75216]:       <nova:owner>
Nov 02 05:05:16 user nova-compute[75216]:         <nova:user uuid="94f0b01ce0c744bdbb937e0a477dcf07">tempest-TestVolumeBootPattern-773799094-project-member</nova:user>
Nov 02 05:05:16 user nova-compute[75216]:         <nova:project uuid="9eeaefe9a0e4468d9bbb99ba3aca7c64">tempest-TestVolumeBootPattern-773799094</nova:project>
Nov 02 05:05:16 user nova-compute[75216]:       </nova:owner>
Nov 02 05:05:16 user nova-compute[75216]:       <nova:ports>
Nov 02 05:05:16 user nova-compute[75216]:         <nova:port uuid="31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c">
Nov 02 05:05:16 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 05:05:16 user nova-compute[75216]:         </nova:port>
Nov 02 05:05:16 user nova-compute[75216]:       </nova:ports>
Nov 02 05:05:16 user nova-compute[75216]:     </nova:instance>
Nov 02 05:05:16 user nova-compute[75216]:   </metadata>
Nov 02 05:05:16 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:05:16 user nova-compute[75216]:     <system>
Nov 02 05:05:16 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:05:16 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:05:16 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:05:16 user nova-compute[75216]:       <entry name="serial">1a50d6b8-242a-485a-9f1c-d3026bad949b</entry>
Nov 02 05:05:16 user nova-compute[75216]:       <entry name="uuid">1a50d6b8-242a-485a-9f1c-d3026bad949b</entry>
Nov 02 05:05:16 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:05:16 user nova-compute[75216]:     </system>
Nov 02 05:05:16 user nova-compute[75216]:   </sysinfo>
Nov 02 05:05:16 user nova-compute[75216]:   <os>
Nov 02 05:05:16 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:05:16 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:05:16 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:05:16 user nova-compute[75216]:   </os>
Nov 02 05:05:16 user nova-compute[75216]:   <features>
Nov 02 05:05:16 user nova-compute[75216]:     <acpi/>
Nov 02 05:05:16 user nova-compute[75216]:     <apic/>
Nov 02 05:05:16 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:05:16 user nova-compute[75216]:   </features>
Nov 02 05:05:16 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:05:16 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:05:16 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:05:16 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:05:16 user nova-compute[75216]:   </clock>
Nov 02 05:05:16 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:05:16 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:05:16 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:05:16 user nova-compute[75216]:   </cpu>
Nov 02 05:05:16 user nova-compute[75216]:   <devices>
Nov 02 05:05:16 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:05:16 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:05:16 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 02 05:05:16 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:05:16 user nova-compute[75216]:       <serial>550e00de-1677-4bca-bd91-6de138b64816</serial>
Nov 02 05:05:16 user nova-compute[75216]:     </disk>
Nov 02 05:05:16 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:05:16 user nova-compute[75216]:       <mac address="fa:16:3e:86:92:67"/>
Nov 02 05:05:16 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:05:16 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:05:16 user nova-compute[75216]:       <target dev="tap31ae12cb-24"/>
Nov 02 05:05:16 user nova-compute[75216]:     </interface>
Nov 02 05:05:16 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:05:16 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1a50d6b8-242a-485a-9f1c-d3026bad949b/console.log" append="off"/>
Nov 02 05:05:16 user nova-compute[75216]:     </serial>
Nov 02 05:05:16 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:05:16 user nova-compute[75216]:     <video>
Nov 02 05:05:16 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:05:16 user nova-compute[75216]:     </video>
Nov 02 05:05:16 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:05:16 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:05:16 user nova-compute[75216]:     </rng>
Nov 02 05:05:16 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:05:16 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:05:16 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:05:16 user nova-compute[75216]:     </memballoon>
Nov 02 05:05:16 user nova-compute[75216]:   </devices>
Nov 02 05:05:16 user nova-compute[75216]: </domain>
Nov 02 05:05:16 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-722897594',display_name='tempest-TestVolumeBootPattern-volume-backed-server-722897594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-722897594',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPHR6cuXfP45cr+9JuBshhxqoGTl2O3mAVMlY/qgyxq0pkxiusWrcsRFUllkwsaA3M83DOUF3k9x9WDrUgNTUy0hb6w8RY77+2xR2uKfcwUG3Q9vrYYSUJ7djZ6kvaS+Q==',key_name='tempest-keypair-483486078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-h3uajbrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=1a50d6b8-242a-485a-9f1c-d3026bad949b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:92:67,bridge_name='br-int',has_traffic_filtering=True,id=31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ae12cb-24') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG os_vif [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:92:67,bridge_name='br-int',has_traffic_filtering=True,id=31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ae12cb-24') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3728e507-23f2-591d-a7f1-812722d4bb28', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31ae12cb-24, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31ae12cb-24, col_values=(('qos', UUID('edf84f7d-4e51-4414-9c06-21e0119fa7b9')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31ae12cb-24, col_values=(('external_ids', {'iface-id': '31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:92:67', 'vm-uuid': '1a50d6b8-242a-485a-9f1c-d3026bad949b'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:16 user nova-compute[75216]: INFO os_vif [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:92:67,bridge_name='br-int',has_traffic_filtering=True,id=31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ae12cb-24')
Nov 02 05:05:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:05:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No VIF found with MAC fa:16:3e:86:92:67, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-417f27ee-1517-47bf-ad26-bab5c8da7bfb req-3843dafb-bd18-4908-bc63-b28147d2f019 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-417f27ee-1517-47bf-ad26-bab5c8da7bfb req-3843dafb-bd18-4908-bc63-b28147d2f019 service nova] Acquiring lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-417f27ee-1517-47bf-ad26-bab5c8da7bfb req-3843dafb-bd18-4908-bc63-b28147d2f019 service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-417f27ee-1517-47bf-ad26-bab5c8da7bfb req-3843dafb-bd18-4908-bc63-b28147d2f019 service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-417f27ee-1517-47bf-ad26-bab5c8da7bfb req-3843dafb-bd18-4908-bc63-b28147d2f019 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] No waiting events found dispatching network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:05:18 user nova-compute[75216]: WARNING nova.compute.manager [req-417f27ee-1517-47bf-ad26-bab5c8da7bfb req-3843dafb-bd18-4908-bc63-b28147d2f019 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received unexpected event network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c for instance with vm_state building and task_state spawning.
Nov 02 05:05:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-948bf19e-eb8a-4b81-911c-ff393d19a8f8 req-ae8f7fb6-cfef-4df0-aff4-1b0062f1364b service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-948bf19e-eb8a-4b81-911c-ff393d19a8f8 req-ae8f7fb6-cfef-4df0-aff4-1b0062f1364b service nova] Acquiring lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-948bf19e-eb8a-4b81-911c-ff393d19a8f8 req-ae8f7fb6-cfef-4df0-aff4-1b0062f1364b service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-948bf19e-eb8a-4b81-911c-ff393d19a8f8 req-ae8f7fb6-cfef-4df0-aff4-1b0062f1364b service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-948bf19e-eb8a-4b81-911c-ff393d19a8f8 req-ae8f7fb6-cfef-4df0-aff4-1b0062f1364b service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] No waiting events found dispatching network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:05:21 user nova-compute[75216]: WARNING nova.compute.manager [req-948bf19e-eb8a-4b81-911c-ff393d19a8f8 req-ae8f7fb6-cfef-4df0-aff4-1b0062f1364b service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received unexpected event network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c for instance with vm_state building and task_state spawning.
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:05:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:05:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=25.139610290527344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Instance spawned successfully.
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Applying migration context for instance e60eecf5-3aca-45c4-8cd5-b577798465c3 as it has an incoming, in-progress migration be6e4a35-506a-4c05-8506-99d8d34d528a. Migration status is finished {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 05:05:21 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating resource usage from migration be6e4a35-506a-4c05-8506-99d8d34d528a
Nov 02 05:05:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:21 user nova-compute[75216]: INFO nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1a50d6b8-242a-485a-9f1c-d3026bad949b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Migration be6e4a35-506a-4c05-8506-99d8d34d528a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e60eecf5-3aca-45c4-8cd5-b577798465c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:05:21 user nova-compute[75216]: INFO nova.compute.manager [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Took 58.20 seconds to build instance.
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-87cae97f-f20d-4d4b-8b06-d0bcbedc4289 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.370s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:05:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:05:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:05:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:05:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:05:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:05:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid e99b36cc-571e-46d6-9a30-7aa3a0801ffd {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:05:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:05:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:05:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:05:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:30 user nova-compute[75216]: INFO nova.compute.manager [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Unshelving
Nov 02 05:05:31 user nova-compute[75216]: INFO nova.virt.block_device [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Booting with volume 20a03ab2-b1c6-4b78-b168-fb644d4a3201 at /dev/vdc
Nov 02 05:05:31 user nova-compute[75216]: DEBUG os_brick.utils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd70ac08-32f3-4bff-90e3-dfd1ec659418]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e48777c-ec60-491a-ab98-19b5a1b95b11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eecf7c-7aa7-486c-8910-2f40ef4b5edd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984bf7e-a0e0-4183-8471-27aee50e8040]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:05:31 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:05:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3e2751-24a4-45d4-9784-a0ce7a815af3]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG os_brick.utils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating existing volume attachment record: 14b448de-9b34-4905-b358-94a2d3f9e124 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'pci_requests' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:05:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'numa_topology' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:05:53 user nova-compute[75216]: INFO nova.compute.claims [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Claim successful on node user
Nov 02 05:05:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:05:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:53 user nova-compute[75216]: INFO nova.network.neutron [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating port 57f48792-35ab-4c28-a363-c3672ed3ffda with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 05:05:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:05:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquired lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:05:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:05:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:05:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing instance network info cache due to event network-changed-57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:05:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] Acquiring lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Releasing lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:05:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Creating image(s)
Nov 02 05:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] Acquired lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Refreshing network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG nova.objects.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<bcd6130f-c66d-4e4c-80f8-e61d59f662f1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "91eb738eef5b84582612ab2c47af79bb91931600" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "91eb738eef5b84582612ab2c47af79bb91931600" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG nova.virt.images [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] baa01244-0229-4a33-81a2-062df47306a9 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.part /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updated VIF entry in instance network info cache for port 57f48792-35ab-4c28-a363-c3672ed3ffda. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c1fd7d72-fde6-4c9a-8d66-0f1662b66e63 req-98b30bdf-bb0e-4fe8-a781-de030e053c35 service nova] Releasing lock "refresh_cache-bcd6130f-c66d-4e4c-80f8-e61d59f662f1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:05:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.part /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.converted" returned: 0 in 0.508s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "91eb738eef5b84582612ab2c47af79bb91931600" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.120s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600 --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "91eb738eef5b84582612ab2c47af79bb91931600" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "91eb738eef5b84582612ab2c47af79bb91931600" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600,backing_fmt=raw /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600,backing_fmt=raw /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk 1073741824" returned: 0 in 0.053s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "91eb738eef5b84582612ab2c47af79bb91931600" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600 --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'migration_context' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:05:57 user nova-compute[75216]: DEBUG nova.objects.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<bcd6130f-c66d-4e4c-80f8-e61d59f662f1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:05:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Rebasing disk image.
Nov 02 05:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.256s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec -F raw /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec -F raw /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk" returned: 0 in 2.556s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Ensure instance console log exists: /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Start _get_guest_xml network_info=[{"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='367831159073069dd5edd0d24e3a26f8',container_format='bare',created_at=2023-11-02T05:03:37Z,direct_url=<?>,disk_format='qcow2',id=baa01244-0229-4a33-81a2-062df47306a9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2088799543-shelved',owner='ca67de068e45497ba3286b5c50da9335',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T05:03:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '14b448de-9b34-4905-b358-94a2d3f9e124', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roUgIbPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'bcd6130f-c66d-4e4c-80f8-e61d59f662f1', 'attached_at': '', 'detached_at': '', 'volume_id': '20a03ab2-b1c6-4b78-b168-fb644d4a3201', 'serial': '20a03ab2-b1c6-4b78-b168-fb644d4a3201'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:06:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='367831159073069dd5edd0d24e3a26f8',container_format='bare',created_at=2023-11-02T05:03:37Z,direct_url=<?>,disk_format='qcow2',id=baa01244-0229-4a33-81a2-062df47306a9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2088799543-shelved',owner='ca67de068e45497ba3286b5c50da9335',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T05:03:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:06:00 user nova-compute[75216]: DEBUG nova.objects.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<bcd6130f-c66d-4e4c-80f8-e61d59f662f1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roUgIbPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:06:01 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:06:01 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:06:01 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f430b9e-0b0b-4a08-9e80-a54f59fd850e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:06:01 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5613c7b5-1970-445d-bc9a-5ce496577ab2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201] added
Nov 02 05:06:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a797b8-2816-4ce7-bcbb-eb90cd68b954]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a27db-67ca-42d7-a7bb-b4af123ba794]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roUgIbPB {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roUgIbPB" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae0c58-a690-42d9-ad31-9ea75ed03f2e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roUgIbPB'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e61065f-bfc8-4a1e-8c9f-18c29ebde958]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f9fabd-1ec5-45bb-9c2b-ed3c7a5cbff6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f8861-7ce3-464e-bbb5-97fc380c0ecd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260]
Nov 02 05:06:01 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260] successful.
Nov 02 05:06:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8432240-ddb2-40ec-834b-aebbd4f483b9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9d481c-d691-4994-92a8-8083e048cd96]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 (non-flash)
Nov 02 05:06:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e3e20d-fe14-4696-8c64-7bd28a6f6a0f]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:06:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roUgIbPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26233333731636563', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233333731636563', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T05:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2088799543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2088799543',id=34,image_ref='baa01244-0229-4a33-81a2-062df47306a9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-117377760',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-sm1vnak4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member',shelved_at='2023-11-02T05:03:42.830396',shelved_host='user',shelved_image_id='baa01244-0229-4a33-81a2-062df47306a9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=bcd6130f-c66d-4e4c-80f8-e61d59f662f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.objects.base [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<bcd6130f-c66d-4e4c-80f8-e61d59f662f1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:06:02 user nova-compute[75216]:   <uuid>bcd6130f-c66d-4e4c-80f8-e61d59f662f1</uuid>
Nov 02 05:06:02 user nova-compute[75216]:   <name>instance-00000022</name>
Nov 02 05:06:02 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:06:02 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:06:02 user nova-compute[75216]:   <metadata>
Nov 02 05:06:02 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:06:02 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:06:02 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2088799543</nova:name>
Nov 02 05:06:02 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:06:00</nova:creationTime>
Nov 02 05:06:02 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:06:02 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:06:02 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:06:02 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:06:02 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:06:02 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:06:02 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:06:02 user nova-compute[75216]:       <nova:owner>
Nov 02 05:06:02 user nova-compute[75216]:         <nova:user uuid="049f40a6f12742aaa3192675b09644a6">tempest-AttachVolumeShelveTestJSON-1661619051-project-member</nova:user>
Nov 02 05:06:02 user nova-compute[75216]:         <nova:project uuid="ca67de068e45497ba3286b5c50da9335">tempest-AttachVolumeShelveTestJSON-1661619051</nova:project>
Nov 02 05:06:02 user nova-compute[75216]:       </nova:owner>
Nov 02 05:06:02 user nova-compute[75216]:       <nova:root type="image" uuid="baa01244-0229-4a33-81a2-062df47306a9"/>
Nov 02 05:06:02 user nova-compute[75216]:       <nova:ports>
Nov 02 05:06:02 user nova-compute[75216]:         <nova:port uuid="57f48792-35ab-4c28-a363-c3672ed3ffda">
Nov 02 05:06:02 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 05:06:02 user nova-compute[75216]:         </nova:port>
Nov 02 05:06:02 user nova-compute[75216]:       </nova:ports>
Nov 02 05:06:02 user nova-compute[75216]:     </nova:instance>
Nov 02 05:06:02 user nova-compute[75216]:   </metadata>
Nov 02 05:06:02 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:06:02 user nova-compute[75216]:     <system>
Nov 02 05:06:02 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:06:02 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:06:02 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:06:02 user nova-compute[75216]:       <entry name="serial">bcd6130f-c66d-4e4c-80f8-e61d59f662f1</entry>
Nov 02 05:06:02 user nova-compute[75216]:       <entry name="uuid">bcd6130f-c66d-4e4c-80f8-e61d59f662f1</entry>
Nov 02 05:06:02 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:06:02 user nova-compute[75216]:     </system>
Nov 02 05:06:02 user nova-compute[75216]:   </sysinfo>
Nov 02 05:06:02 user nova-compute[75216]:   <os>
Nov 02 05:06:02 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:06:02 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:06:02 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:06:02 user nova-compute[75216]:   </os>
Nov 02 05:06:02 user nova-compute[75216]:   <features>
Nov 02 05:06:02 user nova-compute[75216]:     <acpi/>
Nov 02 05:06:02 user nova-compute[75216]:     <apic/>
Nov 02 05:06:02 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:06:02 user nova-compute[75216]:   </features>
Nov 02 05:06:02 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:06:02 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:06:02 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:06:02 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:06:02 user nova-compute[75216]:   </clock>
Nov 02 05:06:02 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:06:02 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:06:02 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:06:02 user nova-compute[75216]:   </cpu>
Nov 02 05:06:02 user nova-compute[75216]:   <devices>
Nov 02 05:06:02 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:06:02 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:06:02 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk"/>
Nov 02 05:06:02 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:06:02 user nova-compute[75216]:     </disk>
Nov 02 05:06:02 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:06:02 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:06:02 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 02 05:06:02 user nova-compute[75216]:       <target dev="vdc" bus="virtio"/>
Nov 02 05:06:02 user nova-compute[75216]:       <serial>20a03ab2-b1c6-4b78-b168-fb644d4a3201</serial>
Nov 02 05:06:02 user nova-compute[75216]:     </disk>
Nov 02 05:06:02 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:06:02 user nova-compute[75216]:       <mac address="fa:16:3e:13:d2:a0"/>
Nov 02 05:06:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:02 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:06:02 user nova-compute[75216]:       <target dev="tap57f48792-35"/>
Nov 02 05:06:02 user nova-compute[75216]:     </interface>
Nov 02 05:06:02 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:06:02 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/console.log" append="off"/>
Nov 02 05:06:02 user nova-compute[75216]:     </serial>
Nov 02 05:06:02 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:06:02 user nova-compute[75216]:     <video>
Nov 02 05:06:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:02 user nova-compute[75216]:     </video>
Nov 02 05:06:02 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:06:02 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:06:02 user nova-compute[75216]:     </rng>
Nov 02 05:06:02 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:06:02 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:06:02 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:06:02 user nova-compute[75216]:     </memballoon>
Nov 02 05:06:02 user nova-compute[75216]:   </devices>
Nov 02 05:06:02 user nova-compute[75216]: </domain>
Nov 02 05:06:02 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T05:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2088799543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2088799543',id=34,image_ref='baa01244-0229-4a33-81a2-062df47306a9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-117377760',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-sm1vnak4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member',shelved_at='2023-11-02T05:03:42.830396',shelved_host='user',shelved_image_id='baa01244-0229-4a33-81a2-062df47306a9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=bcd6130f-c66d-4e4c-80f8-e61d59f662f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG os_vif [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54ccf2c6-1345-5cdd-8294-8284fcf241d1', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57f48792-35, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57f48792-35, col_values=(('qos', UUID('9f0d5ec3-e7d2-4e8c-b74f-e61e50d75f2b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57f48792-35, col_values=(('external_ids', {'iface-id': '57f48792-35ab-4c28-a363-c3672ed3ffda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:d2:a0', 'vm-uuid': 'bcd6130f-c66d-4e4c-80f8-e61d59f662f1'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:02 user nova-compute[75216]: INFO os_vif [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35')
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:06:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No VIF found with MAC fa:16:3e:13:d2:a0, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-619ba0e4-e222-4a56-a937-7460b59a14f6 req-2aec88de-9ff0-4c93-9802-c6ba2dfd47ad service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-619ba0e4-e222-4a56-a937-7460b59a14f6 req-2aec88de-9ff0-4c93-9802-c6ba2dfd47ad service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-619ba0e4-e222-4a56-a937-7460b59a14f6 req-2aec88de-9ff0-4c93-9802-c6ba2dfd47ad service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-619ba0e4-e222-4a56-a937-7460b59a14f6 req-2aec88de-9ff0-4c93-9802-c6ba2dfd47ad service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-619ba0e4-e222-4a56-a937-7460b59a14f6 req-2aec88de-9ff0-4c93-9802-c6ba2dfd47ad service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:06:04 user nova-compute[75216]: WARNING nova.compute.manager [req-619ba0e4-e222-4a56-a937-7460b59a14f6 req-2aec88de-9ff0-4c93-9802-c6ba2dfd47ad service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 05:06:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-d7eb7f4f-9375-4781-b6db-8cea9051c10d req-9a9079d9-9631-4d8d-9b68-b915681fa51c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7eb7f4f-9375-4781-b6db-8cea9051c10d req-9a9079d9-9631-4d8d-9b68-b915681fa51c service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7eb7f4f-9375-4781-b6db-8cea9051c10d req-9a9079d9-9631-4d8d-9b68-b915681fa51c service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7eb7f4f-9375-4781-b6db-8cea9051c10d req-9a9079d9-9631-4d8d-9b68-b915681fa51c service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-d7eb7f4f-9375-4781-b6db-8cea9051c10d req-9a9079d9-9631-4d8d-9b68-b915681fa51c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:06:06 user nova-compute[75216]: WARNING nova.compute.manager [req-d7eb7f4f-9375-4781-b6db-8cea9051c10d req-9a9079d9-9631-4d8d-9b68-b915681fa51c service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 05:06:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:06:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance spawned successfully.
Nov 02 05:06:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3e9954bf-3657-452f-bac9-593a17bf8dc6 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.730s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:06:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:06:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:06:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8282MB free_disk=25.101837158203125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Applying migration context for instance e60eecf5-3aca-45c4-8cd5-b577798465c3 as it has an incoming, in-progress migration be6e4a35-506a-4c05-8506-99d8d34d528a. Migration status is finished {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 05:06:24 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating resource usage from migration be6e4a35-506a-4c05-8506-99d8d34d528a
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1a50d6b8-242a-485a-9f1c-d3026bad949b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Migration be6e4a35-506a-4c05-8506-99d8d34d528a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e60eecf5-3aca-45c4-8cd5-b577798465c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:06:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:06:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:06:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:06:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:06:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:06:32 user nova-compute[75216]: INFO nova.compute.claims [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Claim successful on node user
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:06:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:06:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:06:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Creating image(s)
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "/opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "/opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG nova.policy [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b84115959cd4bdbb399cf64ff2496a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9827da18f210448d81fef636c56fd317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk 1073741824" returned: 0 in 0.069s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.217s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:06:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Cannot resize image /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Ensure instance console log exists: /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Successfully created port: 8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Going to confirm migration 1 {{(pid=75216) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquired lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:06:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'info_cache' on Instance uuid e60eecf5-3aca-45c4-8cd5-b577798465c3 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Successfully updated port: 8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "refresh_cache-1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquired lock "refresh_cache-1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received event network-changed-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Refreshing instance network info cache due to event network-changed-8b3e600c-9730-4e84-bb8b-148e3f4591b9. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] Acquiring lock "refresh_cache-1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [{"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Releasing lock "refresh_cache-e60eecf5-3aca-45c4-8cd5-b577798465c3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'migration_context' on Instance uuid e60eecf5-3aca-45c4-8cd5-b577798465c3 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Updating instance_info_cache with network_info: [{"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.objects.base [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Object Instance<e60eecf5-3aca-45c4-8cd5-b577798465c3> lazy-loaded attributes: info_cache,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Releasing lock "refresh_cache-1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Instance network_info: |[{"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] Acquired lock "refresh_cache-1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Refreshing network info cache for port 8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Start _get_guest_xml network_info=[{"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:06:35 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:35 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-362237143',display_name='tempest-VolumesNegativeTest-instance-362237143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-362237143',id=37,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9827da18f210448d81fef636c56fd317',ramdisk_id='',reservation_id='r-fr9efe1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1015352910',owner_user_name='tempest-VolumesNegativeTest-1015352910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:06:33Z,user_data=None,user_id='4b84115959cd4bdbb399cf64ff2496a0',uuid=1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Converting VIF {"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cc:a4,bridge_name='br-int',has_traffic_filtering=True,id=8b3e600c-9730-4e84-bb8b-148e3f4591b9,network=Network(daee3ad7-3d18-4536-a6f9-d424f27c8742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3e600c-97') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:06:35 user nova-compute[75216]:   <uuid>1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a</uuid>
Nov 02 05:06:35 user nova-compute[75216]:   <name>instance-00000025</name>
Nov 02 05:06:35 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:06:35 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:06:35 user nova-compute[75216]:   <metadata>
Nov 02 05:06:35 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:06:35 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:06:35 user nova-compute[75216]:       <nova:name>tempest-VolumesNegativeTest-instance-362237143</nova:name>
Nov 02 05:06:35 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:06:35</nova:creationTime>
Nov 02 05:06:35 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:06:35 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:06:35 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:06:35 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:06:35 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:06:35 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:06:35 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:06:35 user nova-compute[75216]:       <nova:owner>
Nov 02 05:06:35 user nova-compute[75216]:         <nova:user uuid="4b84115959cd4bdbb399cf64ff2496a0">tempest-VolumesNegativeTest-1015352910-project-member</nova:user>
Nov 02 05:06:35 user nova-compute[75216]:         <nova:project uuid="9827da18f210448d81fef636c56fd317">tempest-VolumesNegativeTest-1015352910</nova:project>
Nov 02 05:06:35 user nova-compute[75216]:       </nova:owner>
Nov 02 05:06:35 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:06:35 user nova-compute[75216]:       <nova:ports>
Nov 02 05:06:35 user nova-compute[75216]:         <nova:port uuid="8b3e600c-9730-4e84-bb8b-148e3f4591b9">
Nov 02 05:06:35 user nova-compute[75216]:           <nova:ip type="fixed" address="192.168.233.85" ipVersion="4"/>
Nov 02 05:06:35 user nova-compute[75216]:         </nova:port>
Nov 02 05:06:35 user nova-compute[75216]:       </nova:ports>
Nov 02 05:06:35 user nova-compute[75216]:     </nova:instance>
Nov 02 05:06:35 user nova-compute[75216]:   </metadata>
Nov 02 05:06:35 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:06:35 user nova-compute[75216]:     <system>
Nov 02 05:06:35 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:06:35 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:06:35 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:06:35 user nova-compute[75216]:       <entry name="serial">1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a</entry>
Nov 02 05:06:35 user nova-compute[75216]:       <entry name="uuid">1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a</entry>
Nov 02 05:06:35 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:06:35 user nova-compute[75216]:     </system>
Nov 02 05:06:35 user nova-compute[75216]:   </sysinfo>
Nov 02 05:06:35 user nova-compute[75216]:   <os>
Nov 02 05:06:35 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:06:35 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:06:35 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:06:35 user nova-compute[75216]:   </os>
Nov 02 05:06:35 user nova-compute[75216]:   <features>
Nov 02 05:06:35 user nova-compute[75216]:     <acpi/>
Nov 02 05:06:35 user nova-compute[75216]:     <apic/>
Nov 02 05:06:35 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:06:35 user nova-compute[75216]:   </features>
Nov 02 05:06:35 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:06:35 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:06:35 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:06:35 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:06:35 user nova-compute[75216]:   </clock>
Nov 02 05:06:35 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:06:35 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:06:35 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:06:35 user nova-compute[75216]:   </cpu>
Nov 02 05:06:35 user nova-compute[75216]:   <devices>
Nov 02 05:06:35 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:06:35 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:06:35 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk"/>
Nov 02 05:06:35 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:06:35 user nova-compute[75216]:     </disk>
Nov 02 05:06:35 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:06:35 user nova-compute[75216]:       <mac address="fa:16:3e:4d:cc:a4"/>
Nov 02 05:06:35 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:35 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:06:35 user nova-compute[75216]:       <target dev="tap8b3e600c-97"/>
Nov 02 05:06:35 user nova-compute[75216]:     </interface>
Nov 02 05:06:35 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:06:35 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/console.log" append="off"/>
Nov 02 05:06:35 user nova-compute[75216]:     </serial>
Nov 02 05:06:35 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:06:35 user nova-compute[75216]:     <video>
Nov 02 05:06:35 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:35 user nova-compute[75216]:     </video>
Nov 02 05:06:35 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:06:35 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:06:35 user nova-compute[75216]:     </rng>
Nov 02 05:06:35 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:06:35 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:06:35 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:06:35 user nova-compute[75216]:     </memballoon>
Nov 02 05:06:35 user nova-compute[75216]:   </devices>
Nov 02 05:06:35 user nova-compute[75216]: </domain>
Nov 02 05:06:35 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-362237143',display_name='tempest-VolumesNegativeTest-instance-362237143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-362237143',id=37,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9827da18f210448d81fef636c56fd317',ramdisk_id='',reservation_id='r-fr9efe1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1015352910',owner_user_name='tempest-VolumesNegativeTest-1015352910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:06:33Z,user_data=None,user_id='4b84115959cd4bdbb399cf64ff2496a0',uuid=1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Converting VIF {"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cc:a4,bridge_name='br-int',has_traffic_filtering=True,id=8b3e600c-9730-4e84-bb8b-148e3f4591b9,network=Network(daee3ad7-3d18-4536-a6f9-d424f27c8742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3e600c-97') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG os_vif [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cc:a4,bridge_name='br-int',has_traffic_filtering=True,id=8b3e600c-9730-4e84-bb8b-148e3f4591b9,network=Network(daee3ad7-3d18-4536-a6f9-d424f27c8742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3e600c-97') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a62337f-4a94-5a50-ad5d-ce5cd7593ff1', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b3e600c-97, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b3e600c-97, col_values=(('qos', UUID('c02b60d1-ee4a-436c-8882-e64a6ac44411')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b3e600c-97, col_values=(('external_ids', {'iface-id': '8b3e600c-9730-4e84-bb8b-148e3f4591b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:cc:a4', 'vm-uuid': '1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:35 user nova-compute[75216]: INFO os_vif [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cc:a4,bridge_name='br-int',has_traffic_filtering=True,id=8b3e600c-9730-4e84-bb8b-148e3f4591b9,network=Network(daee3ad7-3d18-4536-a6f9-d424f27c8742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3e600c-97')
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] No VIF found with MAC fa:16:3e:4d:cc:a4, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:06:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.351s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:36 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Deleted allocation for migration be6e4a35-506a-4c05-8506-99d8d34d528a
Nov 02 05:06:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac06380d-4aa8-416f-a953-48cddc811e47 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.636s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Updated VIF entry in instance network info cache for port 8b3e600c-9730-4e84-bb8b-148e3f4591b9. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:06:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Updating instance_info_cache with network_info: [{"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0b038e1e-c1d3-4d39-8b94-dd145659078c req-32ba3422-1127-45c0-bf97-d2abb851fcba service nova] Releasing lock "refresh_cache-1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c3856cd-1f7f-4029-8277-fe1e309c05e0 req-4d8f2e14-9917-42f3-8427-409e309a1a03 service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received event network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c3856cd-1f7f-4029-8277-fe1e309c05e0 req-4d8f2e14-9917-42f3-8427-409e309a1a03 service nova] Acquiring lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c3856cd-1f7f-4029-8277-fe1e309c05e0 req-4d8f2e14-9917-42f3-8427-409e309a1a03 service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c3856cd-1f7f-4029-8277-fe1e309c05e0 req-4d8f2e14-9917-42f3-8427-409e309a1a03 service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c3856cd-1f7f-4029-8277-fe1e309c05e0 req-4d8f2e14-9917-42f3-8427-409e309a1a03 service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] No waiting events found dispatching network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:06:37 user nova-compute[75216]: WARNING nova.compute.manager [req-8c3856cd-1f7f-4029-8277-fe1e309c05e0 req-4d8f2e14-9917-42f3-8427-409e309a1a03 service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received unexpected event network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 for instance with vm_state building and task_state spawning.
Nov 02 05:06:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-662369aa-6340-434a-a197-c90b1df87e57 req-cdd7b461-23fb-4715-931a-742846ce66e3 service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received event network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-662369aa-6340-434a-a197-c90b1df87e57 req-cdd7b461-23fb-4715-931a-742846ce66e3 service nova] Acquiring lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-662369aa-6340-434a-a197-c90b1df87e57 req-cdd7b461-23fb-4715-931a-742846ce66e3 service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-662369aa-6340-434a-a197-c90b1df87e57 req-cdd7b461-23fb-4715-931a-742846ce66e3 service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-662369aa-6340-434a-a197-c90b1df87e57 req-cdd7b461-23fb-4715-931a-742846ce66e3 service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] No waiting events found dispatching network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:06:39 user nova-compute[75216]: WARNING nova.compute.manager [req-662369aa-6340-434a-a197-c90b1df87e57 req-cdd7b461-23fb-4715-931a-742846ce66e3 service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received unexpected event network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 for instance with vm_state building and task_state spawning.
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:06:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Instance spawned successfully.
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:39 user nova-compute[75216]: INFO nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 02 05:06:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:06:39 user nova-compute[75216]: INFO nova.compute.manager [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Took 7.49 seconds to build instance.
Nov 02 05:06:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f41edbf9-01ec-48e0-b908-7faed8e957ef tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.607s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:06:46 user nova-compute[75216]: INFO nova.compute.claims [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Claim successful on node user
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:06:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.policy [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d10dc8da91e46ffa095d50b13731b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa7dd9f60624ed68e65b20d0f921f56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:06:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Creating image(s)
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "/opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "/opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "/opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.230s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.228s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Cannot resize image /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Ensure instance console log exists: /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Successfully created port: bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Successfully updated port: bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquired lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-changed-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Refreshing instance network info cache due to event network-changed-bf8a785e-9ff6-4209-ab93-82c3c3adc396. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] Acquiring lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updating instance_info_cache with network_info: [{"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Releasing lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Instance network_info: |[{"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] Acquired lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Refreshing network info cache for port bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Start _get_guest_xml network_info=[{"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:06:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-927850970',display_name='tempest-TestServerVolumeAttachmentScenario-server-927850970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-927850970',id=38,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK81vLlUJvQJED2ff3Wo4ZpiOVFKIpMJLKL9DspfDGT1vfoKaHtQNoSKNJ2zZ2rwx5XXksBRQ/j4mBrQoN7wrBLRKYMbhkgaaOvbgEOwum8NUYNKC9WKuj8WmnAkxgpQIA==',key_name='tempest-keypair-1341377621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa7dd9f60624ed68e65b20d0f921f56',ramdisk_id='',reservation_id='r-vdis71rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-468811425',owner_user_name='tempest-TestServerVolumeAttachmentScenario-468811425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d10dc8da91e46ffa095d50b13731b53',uuid=6eb5bdfc-4edd-409c-b228-f557b1aac60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Converting VIF {"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=bf8a785e-9ff6-4209-ab93-82c3c3adc396,network=Network(4ecda183-b41c-48c6-8d7d-59c695e35376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8a785e-9f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'pci_devices' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:06:49 user nova-compute[75216]:   <uuid>6eb5bdfc-4edd-409c-b228-f557b1aac60e</uuid>
Nov 02 05:06:49 user nova-compute[75216]:   <name>instance-00000026</name>
Nov 02 05:06:49 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:06:49 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:06:49 user nova-compute[75216]:   <metadata>
Nov 02 05:06:49 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:06:49 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:06:49 user nova-compute[75216]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-927850970</nova:name>
Nov 02 05:06:49 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:06:49</nova:creationTime>
Nov 02 05:06:49 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:06:49 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:06:49 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:06:49 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:06:49 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:06:49 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:06:49 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:06:49 user nova-compute[75216]:       <nova:owner>
Nov 02 05:06:49 user nova-compute[75216]:         <nova:user uuid="6d10dc8da91e46ffa095d50b13731b53">tempest-TestServerVolumeAttachmentScenario-468811425-project-member</nova:user>
Nov 02 05:06:49 user nova-compute[75216]:         <nova:project uuid="8aa7dd9f60624ed68e65b20d0f921f56">tempest-TestServerVolumeAttachmentScenario-468811425</nova:project>
Nov 02 05:06:49 user nova-compute[75216]:       </nova:owner>
Nov 02 05:06:49 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:06:49 user nova-compute[75216]:       <nova:ports>
Nov 02 05:06:49 user nova-compute[75216]:         <nova:port uuid="bf8a785e-9ff6-4209-ab93-82c3c3adc396">
Nov 02 05:06:49 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 05:06:49 user nova-compute[75216]:         </nova:port>
Nov 02 05:06:49 user nova-compute[75216]:       </nova:ports>
Nov 02 05:06:49 user nova-compute[75216]:     </nova:instance>
Nov 02 05:06:49 user nova-compute[75216]:   </metadata>
Nov 02 05:06:49 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:06:49 user nova-compute[75216]:     <system>
Nov 02 05:06:49 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:06:49 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:06:49 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:06:49 user nova-compute[75216]:       <entry name="serial">6eb5bdfc-4edd-409c-b228-f557b1aac60e</entry>
Nov 02 05:06:49 user nova-compute[75216]:       <entry name="uuid">6eb5bdfc-4edd-409c-b228-f557b1aac60e</entry>
Nov 02 05:06:49 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:06:49 user nova-compute[75216]:     </system>
Nov 02 05:06:49 user nova-compute[75216]:   </sysinfo>
Nov 02 05:06:49 user nova-compute[75216]:   <os>
Nov 02 05:06:49 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:06:49 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:06:49 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:06:49 user nova-compute[75216]:   </os>
Nov 02 05:06:49 user nova-compute[75216]:   <features>
Nov 02 05:06:49 user nova-compute[75216]:     <acpi/>
Nov 02 05:06:49 user nova-compute[75216]:     <apic/>
Nov 02 05:06:49 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:06:49 user nova-compute[75216]:   </features>
Nov 02 05:06:49 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:06:49 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:06:49 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:06:49 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:06:49 user nova-compute[75216]:   </clock>
Nov 02 05:06:49 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:06:49 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:06:49 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:06:49 user nova-compute[75216]:   </cpu>
Nov 02 05:06:49 user nova-compute[75216]:   <devices>
Nov 02 05:06:49 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:06:49 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:06:49 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk"/>
Nov 02 05:06:49 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:06:49 user nova-compute[75216]:     </disk>
Nov 02 05:06:49 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:06:49 user nova-compute[75216]:       <mac address="fa:16:3e:fb:f5:37"/>
Nov 02 05:06:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:49 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:06:49 user nova-compute[75216]:       <target dev="tapbf8a785e-9f"/>
Nov 02 05:06:49 user nova-compute[75216]:     </interface>
Nov 02 05:06:49 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:06:49 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/console.log" append="off"/>
Nov 02 05:06:49 user nova-compute[75216]:     </serial>
Nov 02 05:06:49 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:06:49 user nova-compute[75216]:     <video>
Nov 02 05:06:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:49 user nova-compute[75216]:     </video>
Nov 02 05:06:49 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:06:49 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:06:49 user nova-compute[75216]:     </rng>
Nov 02 05:06:49 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:06:49 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:06:49 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:06:49 user nova-compute[75216]:     </memballoon>
Nov 02 05:06:49 user nova-compute[75216]:   </devices>
Nov 02 05:06:49 user nova-compute[75216]: </domain>
Nov 02 05:06:49 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-927850970',display_name='tempest-TestServerVolumeAttachmentScenario-server-927850970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-927850970',id=38,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK81vLlUJvQJED2ff3Wo4ZpiOVFKIpMJLKL9DspfDGT1vfoKaHtQNoSKNJ2zZ2rwx5XXksBRQ/j4mBrQoN7wrBLRKYMbhkgaaOvbgEOwum8NUYNKC9WKuj8WmnAkxgpQIA==',key_name='tempest-keypair-1341377621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa7dd9f60624ed68e65b20d0f921f56',ramdisk_id='',reservation_id='r-vdis71rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-468811425',owner_user_name='tempest-TestServerVolumeAttachmentScenario-468811425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d10dc8da91e46ffa095d50b13731b53',uuid=6eb5bdfc-4edd-409c-b228-f557b1aac60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Converting VIF {"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=bf8a785e-9ff6-4209-ab93-82c3c3adc396,network=Network(4ecda183-b41c-48c6-8d7d-59c695e35376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8a785e-9f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG os_vif [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=bf8a785e-9ff6-4209-ab93-82c3c3adc396,network=Network(4ecda183-b41c-48c6-8d7d-59c695e35376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8a785e-9f') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bde505d-f3d9-52d8-96c8-e9eecb3dffd7', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf8a785e-9f, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf8a785e-9f, col_values=(('qos', UUID('29b0e6bd-0f9c-426e-ab76-d04d5a90569c')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf8a785e-9f, col_values=(('external_ids', {'iface-id': 'bf8a785e-9ff6-4209-ab93-82c3c3adc396', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:f5:37', 'vm-uuid': '6eb5bdfc-4edd-409c-b228-f557b1aac60e'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:49 user nova-compute[75216]: INFO os_vif [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=bf8a785e-9ff6-4209-ab93-82c3c3adc396,network=Network(4ecda183-b41c-48c6-8d7d-59c695e35376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8a785e-9f')
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No VIF found with MAC fa:16:3e:fb:f5:37, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:06:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updated VIF entry in instance network info cache for port bf8a785e-9ff6-4209-ab93-82c3c3adc396. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:06:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updating instance_info_cache with network_info: [{"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac6a688c-a4df-4e49-b55c-175bd6637a28 req-ee9b186b-cef4-4377-8852-25eb67f04734 service nova] Releasing lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-cb01991d-3149-4f16-8d57-89f918587150 req-79122a5a-79e0-406e-9cda-6ffbb5650ca3 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cb01991d-3149-4f16-8d57-89f918587150 req-79122a5a-79e0-406e-9cda-6ffbb5650ca3 service nova] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cb01991d-3149-4f16-8d57-89f918587150 req-79122a5a-79e0-406e-9cda-6ffbb5650ca3 service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cb01991d-3149-4f16-8d57-89f918587150 req-79122a5a-79e0-406e-9cda-6ffbb5650ca3 service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-cb01991d-3149-4f16-8d57-89f918587150 req-79122a5a-79e0-406e-9cda-6ffbb5650ca3 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] No waiting events found dispatching network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:06:52 user nova-compute[75216]: WARNING nova.compute.manager [req-cb01991d-3149-4f16-8d57-89f918587150 req-79122a5a-79e0-406e-9cda-6ffbb5650ca3 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received unexpected event network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 for instance with vm_state building and task_state spawning.
Nov 02 05:06:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "d56f13bd-5050-4689-a0bd-b06c88db6252" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:06:54 user nova-compute[75216]: INFO nova.compute.claims [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Claim successful on node user
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:06:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Instance spawned successfully.
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:06:54 user nova-compute[75216]: INFO nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:06:54 user nova-compute[75216]: INFO nova.compute.manager [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Took 7.58 seconds to build instance.
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1816f60-a9dd-4765-affc-396bc938a473 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.753s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:06:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.policy [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0dd6755004247af9058fe05adcd950d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513adbd7b8f541febe9927ba78eee782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:06:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Creating image(s)
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "/opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "/opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "/opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-1bc5e511-42ea-4f4b-b27a-625be3d824e2 req-793a27c1-0da4-411c-ab89-806fbf9ef51f service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1bc5e511-42ea-4f4b-b27a-625be3d824e2 req-793a27c1-0da4-411c-ab89-806fbf9ef51f service nova] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1bc5e511-42ea-4f4b-b27a-625be3d824e2 req-793a27c1-0da4-411c-ab89-806fbf9ef51f service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1bc5e511-42ea-4f4b-b27a-625be3d824e2 req-793a27c1-0da4-411c-ab89-806fbf9ef51f service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-1bc5e511-42ea-4f4b-b27a-625be3d824e2 req-793a27c1-0da4-411c-ab89-806fbf9ef51f service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] No waiting events found dispatching network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:06:54 user nova-compute[75216]: WARNING nova.compute.manager [req-1bc5e511-42ea-4f4b-b27a-625be3d824e2 req-793a27c1-0da4-411c-ab89-806fbf9ef51f service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received unexpected event network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 for instance with vm_state active and task_state None.
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk 1073741824" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Successfully created port: eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Cannot resize image /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Ensure instance console log exists: /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Successfully updated port: eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "refresh_cache-d56f13bd-5050-4689-a0bd-b06c88db6252" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquired lock "refresh_cache-d56f13bd-5050-4689-a0bd-b06c88db6252" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received event network-changed-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Refreshing instance network info cache due to event network-changed-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] Acquiring lock "refresh_cache-d56f13bd-5050-4689-a0bd-b06c88db6252" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Updating instance_info_cache with network_info: [{"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Releasing lock "refresh_cache-d56f13bd-5050-4689-a0bd-b06c88db6252" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Instance network_info: |[{"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] Acquired lock "refresh_cache-d56f13bd-5050-4689-a0bd-b06c88db6252" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Refreshing network info cache for port eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Start _get_guest_xml network_info=[{"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:06:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-640741757',display_name='tempest-VolumesActionsTest-instance-640741757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-640741757',id=39,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513adbd7b8f541febe9927ba78eee782',ramdisk_id='',reservation_id='r-r3u6fs04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-796192132',owner_user_name='tempest-VolumesActionsTest-796192132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:06:55Z,user_data=None,user_id='c0dd6755004247af9058fe05adcd950d',uuid=d56f13bd-5050-4689-a0bd-b06c88db6252,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converting VIF {"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:89:a2,bridge_name='br-int',has_traffic_filtering=True,id=eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7d29f-ee') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lazy-loading 'pci_devices' on Instance uuid d56f13bd-5050-4689-a0bd-b06c88db6252 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:06:56 user nova-compute[75216]:   <uuid>d56f13bd-5050-4689-a0bd-b06c88db6252</uuid>
Nov 02 05:06:56 user nova-compute[75216]:   <name>instance-00000027</name>
Nov 02 05:06:56 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:06:56 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:06:56 user nova-compute[75216]:   <metadata>
Nov 02 05:06:56 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:06:56 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:06:56 user nova-compute[75216]:       <nova:name>tempest-VolumesActionsTest-instance-640741757</nova:name>
Nov 02 05:06:56 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:06:56</nova:creationTime>
Nov 02 05:06:56 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:06:56 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:06:56 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:06:56 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:06:56 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:06:56 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:06:56 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:06:56 user nova-compute[75216]:       <nova:owner>
Nov 02 05:06:56 user nova-compute[75216]:         <nova:user uuid="c0dd6755004247af9058fe05adcd950d">tempest-VolumesActionsTest-796192132-project-member</nova:user>
Nov 02 05:06:56 user nova-compute[75216]:         <nova:project uuid="513adbd7b8f541febe9927ba78eee782">tempest-VolumesActionsTest-796192132</nova:project>
Nov 02 05:06:56 user nova-compute[75216]:       </nova:owner>
Nov 02 05:06:56 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:06:56 user nova-compute[75216]:       <nova:ports>
Nov 02 05:06:56 user nova-compute[75216]:         <nova:port uuid="eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12">
Nov 02 05:06:56 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 05:06:56 user nova-compute[75216]:         </nova:port>
Nov 02 05:06:56 user nova-compute[75216]:       </nova:ports>
Nov 02 05:06:56 user nova-compute[75216]:     </nova:instance>
Nov 02 05:06:56 user nova-compute[75216]:   </metadata>
Nov 02 05:06:56 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:06:56 user nova-compute[75216]:     <system>
Nov 02 05:06:56 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:06:56 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:06:56 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:06:56 user nova-compute[75216]:       <entry name="serial">d56f13bd-5050-4689-a0bd-b06c88db6252</entry>
Nov 02 05:06:56 user nova-compute[75216]:       <entry name="uuid">d56f13bd-5050-4689-a0bd-b06c88db6252</entry>
Nov 02 05:06:56 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:06:56 user nova-compute[75216]:     </system>
Nov 02 05:06:56 user nova-compute[75216]:   </sysinfo>
Nov 02 05:06:56 user nova-compute[75216]:   <os>
Nov 02 05:06:56 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:06:56 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:06:56 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:06:56 user nova-compute[75216]:   </os>
Nov 02 05:06:56 user nova-compute[75216]:   <features>
Nov 02 05:06:56 user nova-compute[75216]:     <acpi/>
Nov 02 05:06:56 user nova-compute[75216]:     <apic/>
Nov 02 05:06:56 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:06:56 user nova-compute[75216]:   </features>
Nov 02 05:06:56 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:06:56 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:06:56 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:06:56 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:06:56 user nova-compute[75216]:   </clock>
Nov 02 05:06:56 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:06:56 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:06:56 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:06:56 user nova-compute[75216]:   </cpu>
Nov 02 05:06:56 user nova-compute[75216]:   <devices>
Nov 02 05:06:56 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:06:56 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:06:56 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk"/>
Nov 02 05:06:56 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:06:56 user nova-compute[75216]:     </disk>
Nov 02 05:06:56 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:06:56 user nova-compute[75216]:       <mac address="fa:16:3e:3d:89:a2"/>
Nov 02 05:06:56 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:56 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:06:56 user nova-compute[75216]:       <target dev="tapeeb7d29f-ee"/>
Nov 02 05:06:56 user nova-compute[75216]:     </interface>
Nov 02 05:06:56 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:06:56 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/console.log" append="off"/>
Nov 02 05:06:56 user nova-compute[75216]:     </serial>
Nov 02 05:06:56 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:06:56 user nova-compute[75216]:     <video>
Nov 02 05:06:56 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:06:56 user nova-compute[75216]:     </video>
Nov 02 05:06:56 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:06:56 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:06:56 user nova-compute[75216]:     </rng>
Nov 02 05:06:56 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:06:56 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:06:56 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:06:56 user nova-compute[75216]:     </memballoon>
Nov 02 05:06:56 user nova-compute[75216]:   </devices>
Nov 02 05:06:56 user nova-compute[75216]: </domain>
Nov 02 05:06:56 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-640741757',display_name='tempest-VolumesActionsTest-instance-640741757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-640741757',id=39,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513adbd7b8f541febe9927ba78eee782',ramdisk_id='',reservation_id='r-r3u6fs04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-796192132',owner_user_name='tempest-VolumesActionsTest-796192132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:06:55Z,user_data=None,user_id='c0dd6755004247af9058fe05adcd950d',uuid=d56f13bd-5050-4689-a0bd-b06c88db6252,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converting VIF {"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:89:a2,bridge_name='br-int',has_traffic_filtering=True,id=eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7d29f-ee') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG os_vif [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:89:a2,bridge_name='br-int',has_traffic_filtering=True,id=eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7d29f-ee') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a96d216-8d7e-585c-a127-2297a0f94694', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb7d29f-ee, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeb7d29f-ee, col_values=(('qos', UUID('9791c2a5-87f4-40d6-b9f3-c57ecbc377b0')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeb7d29f-ee, col_values=(('external_ids', {'iface-id': 'eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:89:a2', 'vm-uuid': 'd56f13bd-5050-4689-a0bd-b06c88db6252'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: INFO os_vif [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:89:a2,bridge_name='br-int',has_traffic_filtering=True,id=eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7d29f-ee')
Nov 02 05:06:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:06:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] No VIF found with MAC fa:16:3e:3d:89:a2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:06:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Updated VIF entry in instance network info cache for port eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:06:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Updating instance_info_cache with network_info: [{"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:06:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6bcdac6-94d1-495a-b440-d0bfcbdda1ec req-956b072a-3fa5-45de-8582-469cec5e4e21 service nova] Releasing lock "refresh_cache-d56f13bd-5050-4689-a0bd-b06c88db6252" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-9bac068c-fba8-4466-ada7-1fce636934ce req-54f80f5a-1e79-444e-b0b4-a6dfcae90b17 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received event network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bac068c-fba8-4466-ada7-1fce636934ce req-54f80f5a-1e79-444e-b0b4-a6dfcae90b17 service nova] Acquiring lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bac068c-fba8-4466-ada7-1fce636934ce req-54f80f5a-1e79-444e-b0b4-a6dfcae90b17 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bac068c-fba8-4466-ada7-1fce636934ce req-54f80f5a-1e79-444e-b0b4-a6dfcae90b17 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-9bac068c-fba8-4466-ada7-1fce636934ce req-54f80f5a-1e79-444e-b0b4-a6dfcae90b17 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] No waiting events found dispatching network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:06:58 user nova-compute[75216]: WARNING nova.compute.manager [req-9bac068c-fba8-4466-ada7-1fce636934ce req-54f80f5a-1e79-444e-b0b4-a6dfcae90b17 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received unexpected event network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 for instance with vm_state building and task_state spawning.
Nov 02 05:06:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:06:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-df0781c3-f657-4f3b-9366-fa8e8d70f820 req-6a330a27-26b8-44d6-9d8a-503c53225ea6 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received event network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-df0781c3-f657-4f3b-9366-fa8e8d70f820 req-6a330a27-26b8-44d6-9d8a-503c53225ea6 service nova] Acquiring lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-df0781c3-f657-4f3b-9366-fa8e8d70f820 req-6a330a27-26b8-44d6-9d8a-503c53225ea6 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-df0781c3-f657-4f3b-9366-fa8e8d70f820 req-6a330a27-26b8-44d6-9d8a-503c53225ea6 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-df0781c3-f657-4f3b-9366-fa8e8d70f820 req-6a330a27-26b8-44d6-9d8a-503c53225ea6 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] No waiting events found dispatching network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:07:00 user nova-compute[75216]: WARNING nova.compute.manager [req-df0781c3-f657-4f3b-9366-fa8e8d70f820 req-6a330a27-26b8-44d6-9d8a-503c53225ea6 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received unexpected event network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 for instance with vm_state building and task_state spawning.
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:07:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Instance spawned successfully.
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:07:00 user nova-compute[75216]: INFO nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 02 05:07:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:07:00 user nova-compute[75216]: INFO nova.compute.manager [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Took 6.81 seconds to build instance.
Nov 02 05:07:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-613f176a-3116-4f56-b980-06e868cfebc7 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.976s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-changed-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Refreshing instance network info cache due to event network-changed-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] Acquiring lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] Acquired lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG nova.network.neutron [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Refreshing network info cache for port 31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG nova.network.neutron [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updated VIF entry in instance network info cache for port 31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG nova.network.neutron [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updating instance_info_cache with network_info: [{"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bf6bdaf0-206b-42b8-b409-bfb8ccc4d585 req-bef24c18-9481-4cdd-9e39-526baa1fb202 service nova] Releasing lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:07:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:07:19 user nova-compute[75216]: INFO nova.compute.claims [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Claim successful on node user
Nov 02 05:07:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:07:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:07:19 user nova-compute[75216]: INFO nova.virt.block_device [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Booting with volume snapshot e7042a0a-4992-4d70-af0e-c81f7588546f at /dev/vda
Nov 02 05:07:19 user nova-compute[75216]: DEBUG nova.policy [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94f0b01ce0c744bdbb937e0a477dcf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eeaefe9a0e4468d9bbb99ba3aca7c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:07:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Successfully created port: 6a89b993-eaee-4bee-962d-2f5c951c42d9 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:07:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:07:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:07:20 user nova-compute[75216]: INFO nova.compute.manager [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Detaching volume 20a03ab2-b1c6-4b78-b168-fb644d4a3201
Nov 02 05:07:20 user nova-compute[75216]: INFO nova.virt.block_device [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Attempting to driver detach volume 20a03ab2-b1c6-4b78-b168-fb644d4a3201 from mountpoint /dev/vdc
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Attempting to detach device vdc from instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:07:21 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:07:21 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 05:07:21 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 05:07:21 user nova-compute[75216]:   <serial>20a03ab2-b1c6-4b78-b168-fb644d4a3201</serial>
Nov 02 05:07:21 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 05:07:21 user nova-compute[75216]: </disk>
Nov 02 05:07:21 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:07:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully detached device vdc from instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 from the persistent domain config.
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:07:21 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:07:21 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 05:07:21 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 05:07:21 user nova-compute[75216]:   <serial>20a03ab2-b1c6-4b78-b168-fb644d4a3201</serial>
Nov 02 05:07:21 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 05:07:21 user nova-compute[75216]: </disk>
Nov 02 05:07:21 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Successfully updated port: 6a89b993-eaee-4bee-962d-2f5c951c42d9 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "refresh_cache-4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquired lock "refresh_cache-4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Received event network-changed-6a89b993-eaee-4bee-962d-2f5c951c42d9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Refreshing instance network info cache due to event network-changed-6a89b993-eaee-4bee-962d-2f5c951c42d9. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] Acquiring lock "refresh_cache-4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Updating instance_info_cache with network_info: [{"id": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "address": "fa:16:3e:f3:bb:56", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a89b993-ea", "ovs_interfaceid": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Releasing lock "refresh_cache-4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Instance network_info: |[{"id": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "address": "fa:16:3e:f3:bb:56", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a89b993-ea", "ovs_interfaceid": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] Acquired lock "refresh_cache-4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Refreshing network info cache for port 6a89b993-eaee-4bee-962d-2f5c951c42d9 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Updated VIF entry in instance network info cache for port 6a89b993-eaee-4bee-962d-2f5c951c42d9. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Updating instance_info_cache with network_info: [{"id": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "address": "fa:16:3e:f3:bb:56", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a89b993-ea", "ovs_interfaceid": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:07:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2054d6f1-004e-4fa9-b6f8-b118ed1039a6 req-da5c8bb5-1369-4152-b7f2-43deb75fb9d2 service nova] Releasing lock "refresh_cache-4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:07:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=7800MB free_disk=24.996814727783203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1a50d6b8-242a-485a-9f1c-d3026bad949b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e60eecf5-3aca-45c4-8cd5-b577798465c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance d56f13bd-5050-4689-a0bd-b06c88db6252 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG os_brick.utils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a43ff18-5373-4f2e-a78c-7b94add0b13a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d9cbb2-98c6-4f93-a835-b2241b016184]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e017cf-029e-454e-b164-0116973ea8d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f8fa60-71b2-4f2a-9677-65efe5331c29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:07:25 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:07:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9064c0cd-e0b3-42bc-b4ae-6e8c6312751f]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG os_brick.utils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:07:25 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Updating existing volume attachment record: 5121e2cf-832b-4af3-8b22-94dcd49ca54c {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:07:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:07:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:07:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:07:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:07:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:07:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updating instance_info_cache with network_info: [{"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:07:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-1a50d6b8-242a-485a-9f1c-d3026bad949b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:07:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:07:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:07:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 is timed out.
Nov 02 05:07:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully detached device vdc from instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1 from the live domain config.
Nov 02 05:07:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roUgIbPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:07:41 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffefd831-fdfb-4576-9770-3ea09f09f6fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b238a264-c549-4100-a5cb-0d84e2fd6536\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:07:41 user nova-compute[75216]: No targets found.
Nov 02 05:07:41 user nova-compute[75216]: iSNS:
Nov 02 05:07:41 user nova-compute[75216]: No targets found.
Nov 02 05:07:41 user nova-compute[75216]: STATIC:
Nov 02 05:07:41 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816
Nov 02 05:07:41 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:07:41 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:07:41 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201
Nov 02 05:07:41 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:07:41 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:07:41 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633
Nov 02 05:07:41 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:07:41 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:07:41 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:b238a264-c549-4100-a5cb-0d84e2fd6536
Nov 02 05:07:41 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:07:41 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:07:41 user nova-compute[75216]: FIRMWARE:
Nov 02 05:07:41 user nova-compute[75216]: No targets found.
Nov 02 05:07:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:07:41 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:07:41 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf832a-dccc-40c4-bfb9-664e55f3694a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b238a264-c549-4100-a5cb-0d84e2fd6536\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91606fc-0074-47a9-ac90-0938229eb773]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b238a264-c549-4100-a5cb-0d84e2fd6536 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b238a264-c549-4100-a5cb-0d84e2fd6536 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b238a264-c549-4100-a5cb-0d84e2fd6536 (non-flash)
Nov 02 05:07:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec450820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c9965-0c0f-4065-b674-d90e7936a021]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7b9583-9662-4aea-8d0c-d009832b0bab]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[667db6a3-a41c-49dd-9f3d-1ad7070e0022]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[341013e2-40c1-4f34-b2e2-598f36490f2d]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8f5941-3b21-4fd9-b0bb-e1bab9b3b9b7]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f6d20-8388-4bac-aa8a-6306336f04aa]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260]
Nov 02 05:07:41 user nova-compute[75216]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201, portal: 172.16.0.220,3260] successful.
Nov 02 05:07:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a03ab2-b1c6-4b78-b168-fb644d4a3201 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5d53f8-9e5c-42f6-94c5-0625705938c1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] <== disconnect_volume: return (286ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:07:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:07:42 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'flavor' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:07:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4a75689-0dfe-4ccd-a132-b6a7e1bdbe2c tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.859s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.volume.cinder [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Update attachment failed for attachment 5121e2cf-832b-4af3-8b22-94dcd49ca54c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Traceback (most recent call last):
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     driver_block_device.attach_block_devices(
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     _log_and_attach(device)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     bdm.attach(*attach_args, **attach_kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 819, in attach
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     super(DriverVolSnapshotBlockDevice, self).attach(
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     self._do_attach(context, instance, volume, volume_api,
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     self._volume_attach(context, volume, connector, instance,
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     connection_info = volume_api.attachment_update(
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     res = method(self, ctx, *args, **kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     with excutils.save_and_reraise_exception():
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     self.force_reraise()
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     raise self.value
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     return method.func(obj, *args, **kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     resp = self._update('/attachments/%s' % id, body)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     return self.request(url, method, **kwargs)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc]     raise exceptions.from_response(resp, body)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0)
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] 
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.compute.claims [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Aborting claim: <nova.compute.claims.Claim object at 0x7f45ec215a80> {{(pid=75216) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.423s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Build of instance 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0) {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.compute.utils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Build of instance 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75216) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 02 05:07:43 user nova-compute[75216]: ERROR nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Build of instance 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0): nova.exception.BuildAbortException: Build of instance 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0)
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Unplugging VIFs for instance {{(pid=75216) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1718720199',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1718720199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1718720199',id=40,image_ref='ccf55fb2-2b9e-45bf-9919-c46c964cc5af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9TPoapLoXTZzdLSf6Q7frYVgO/4iBgaURsRPEd2DyiW3v+n7HMiSNuJf/79EWPxTYY8tpVwUC96b1JW5ojux0L7zx0VXaGHMkXSxqxGNBKFBj+pGVKHw8/JgpEA8t03w==',key_name='tempest-keypair-711175852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-fqra1uw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-773799094',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:07:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=4c8dcdf9-cc8d-4170-9dc5-10d120a711dc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "address": "fa:16:3e:f3:bb:56", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a89b993-ea", "ovs_interfaceid": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "address": "fa:16:3e:f3:bb:56", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a89b993-ea", "ovs_interfaceid": "6a89b993-eaee-4bee-962d-2f5c951c42d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:bb:56,bridge_name='br-int',has_traffic_filtering=True,id=6a89b993-eaee-4bee-962d-2f5c951c42d9,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a89b993-ea') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG os_vif [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:bb:56,bridge_name='br-int',has_traffic_filtering=True,id=6a89b993-eaee-4bee-962d-2f5c951c42d9,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a89b993-ea') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a89b993-ea, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:07:43 user nova-compute[75216]: INFO os_vif [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:bb:56,bridge_name='br-int',has_traffic_filtering=True,id=6a89b993-eaee-4bee-962d-2f5c951c42d9,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a89b993-ea')
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Unplugged VIFs for instance {{(pid=75216) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:07:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:07:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:07:44 user nova-compute[75216]: INFO nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Took 0.52 seconds to deallocate network for instance.
Nov 02 05:07:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Detaching volume: a3dade6f-6ae7-4651-bd0a-9e96ec67162d {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 05:07:44 user nova-compute[75216]: INFO nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Detaching volume a3dade6f-6ae7-4651-bd0a-9e96ec67162d
Nov 02 05:07:44 user nova-compute[75216]: ERROR nova.virt.block_device [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Unable to call for a driver detach of volume a3dade6f-6ae7-4651-bd0a-9e96ec67162d due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1d0ea171-b36d-443e-9858-60ed926176f0)
Nov 02 05:07:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc] Deleting volume: a3dade6f-6ae7-4651-bd0a-9e96ec67162d {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 05:07:44 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Deleted allocations for instance 4c8dcdf9-cc8d-4170-9dc5-10d120a711dc
Nov 02 05:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-717f10dd-b671-4e23-9f90-3fbbdfb2a784 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "4c8dcdf9-cc8d-4170-9dc5-10d120a711dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.208s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:07:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 3245-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:07:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:07:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:07:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:07:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:07:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:07:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:07:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:08:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:08:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:08:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:08:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:08:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:08:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:11 user nova-compute[75216]: INFO nova.compute.manager [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Terminating instance
Nov 02 05:08:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-67c6b4ea-a4ed-4048-9b6f-ce0af1456944 req-85736dbf-0a67-4dfa-9e7c-88a41c1ef745 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-67c6b4ea-a4ed-4048-9b6f-ce0af1456944 req-85736dbf-0a67-4dfa-9e7c-88a41c1ef745 service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-67c6b4ea-a4ed-4048-9b6f-ce0af1456944 req-85736dbf-0a67-4dfa-9e7c-88a41c1ef745 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-67c6b4ea-a4ed-4048-9b6f-ce0af1456944 req-85736dbf-0a67-4dfa-9e7c-88a41c1ef745 service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-67c6b4ea-a4ed-4048-9b6f-ce0af1456944 req-85736dbf-0a67-4dfa-9e7c-88a41c1ef745 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-67c6b4ea-a4ed-4048-9b6f-ce0af1456944 req-85736dbf-0a67-4dfa-9e7c-88a41c1ef745 service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-unplugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:08:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Instance destroyed successfully.
Nov 02 05:08:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'resources' on Instance uuid bcd6130f-c66d-4e4c-80f8-e61d59f662f1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T05:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2088799543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2088799543',id=34,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp/OO6sRIUyd7lJWqOohJY7Okmd7HecjmvgLRJ/CmJZ/1xScmDAxFb8TwNkKtAm4mJGJ1O5rTfrxPxdMxXi5fWjnWXo8KDBv6eTtt8Ksivq3jY1j1FW4P3f3pJuj2mLfQ==',key_name='tempest-keypair-117377760',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-sm1vnak4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=bcd6130f-c66d-4e4c-80f8-e61d59f662f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "57f48792-35ab-4c28-a363-c3672ed3ffda", "address": "fa:16:3e:13:d2:a0", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f48792-35", "ovs_interfaceid": "57f48792-35ab-4c28-a363-c3672ed3ffda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG os_vif [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57f48792-35, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f0d5ec3-e7d2-4e8c-b74f-e61e50d75f2b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:12 user nova-compute[75216]: INFO os_vif [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d2:a0,bridge_name='br-int',has_traffic_filtering=True,id=57f48792-35ab-4c28-a363-c3672ed3ffda,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f48792-35')
Nov 02 05:08:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Deleting instance files /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1_del
Nov 02 05:08:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Deletion of /opt/stack/data/nova/instances/bcd6130f-c66d-4e4c-80f8-e61d59f662f1_del complete
Nov 02 05:08:12 user nova-compute[75216]: INFO nova.compute.manager [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 02 05:08:12 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:08:12 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:08:13 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Took 1.10 seconds to deallocate network for instance.
Nov 02 05:08:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ce5fa16-da2d-489c-996f-79f573168caa req-2c7d04d0-dcf6-4e19-88cc-670a13ccdffa service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ce5fa16-da2d-489c-996f-79f573168caa req-2c7d04d0-dcf6-4e19-88cc-670a13ccdffa service nova] Acquiring lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ce5fa16-da2d-489c-996f-79f573168caa req-2c7d04d0-dcf6-4e19-88cc-670a13ccdffa service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2ce5fa16-da2d-489c-996f-79f573168caa req-2c7d04d0-dcf6-4e19-88cc-670a13ccdffa service nova] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ce5fa16-da2d-489c-996f-79f573168caa req-2c7d04d0-dcf6-4e19-88cc-670a13ccdffa service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] No waiting events found dispatching network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:13 user nova-compute[75216]: WARNING nova.compute.manager [req-2ce5fa16-da2d-489c-996f-79f573168caa req-2c7d04d0-dcf6-4e19-88cc-670a13ccdffa service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received unexpected event network-vif-plugged-57f48792-35ab-4c28-a363-c3672ed3ffda for instance with vm_state deleted and task_state None.
Nov 02 05:08:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-2ce5fa16-da2d-489c-996f-79f573168caa req-2c7d04d0-dcf6-4e19-88cc-670a13ccdffa service nova] [instance: bcd6130f-c66d-4e4c-80f8-e61d59f662f1] Received event network-vif-deleted-57f48792-35ab-4c28-a363-c3672ed3ffda {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:08:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:13 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Deleted allocations for instance bcd6130f-c66d-4e4c-80f8-e61d59f662f1
Nov 02 05:08:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cb7a61e6-3aea-4bf3-93a3-9083fc667f50 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "bcd6130f-c66d-4e4c-80f8-e61d59f662f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.591s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "1a50d6b8-242a-485a-9f1c-d3026bad949b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:21 user nova-compute[75216]: INFO nova.compute.manager [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Terminating instance
Nov 02 05:08:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-a49fad73-be49-45f7-8e54-bda959468d28 req-280ef951-90c1-479c-a8df-29527649eb9d service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-vif-unplugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a49fad73-be49-45f7-8e54-bda959468d28 req-280ef951-90c1-479c-a8df-29527649eb9d service nova] Acquiring lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a49fad73-be49-45f7-8e54-bda959468d28 req-280ef951-90c1-479c-a8df-29527649eb9d service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a49fad73-be49-45f7-8e54-bda959468d28 req-280ef951-90c1-479c-a8df-29527649eb9d service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-a49fad73-be49-45f7-8e54-bda959468d28 req-280ef951-90c1-479c-a8df-29527649eb9d service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] No waiting events found dispatching network-vif-unplugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-a49fad73-be49-45f7-8e54-bda959468d28 req-280ef951-90c1-479c-a8df-29527649eb9d service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-vif-unplugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Instance destroyed successfully.
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'resources' on Instance uuid 1a50d6b8-242a-485a-9f1c-d3026bad949b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-722897594',display_name='tempest-TestVolumeBootPattern-volume-backed-server-722897594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-722897594',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPHR6cuXfP45cr+9JuBshhxqoGTl2O3mAVMlY/qgyxq0pkxiusWrcsRFUllkwsaA3M83DOUF3k9x9WDrUgNTUy0hb6w8RY77+2xR2uKfcwUG3Q9vrYYSUJ7djZ6kvaS+Q==',key_name='tempest-keypair-483486078',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:05:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-h3uajbrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=1a50d6b8-242a-485a-9f1c-d3026bad949b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "address": "fa:16:3e:86:92:67", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ae12cb-24", "ovs_interfaceid": "31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:92:67,bridge_name='br-int',has_traffic_filtering=True,id=31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ae12cb-24') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_vif [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:92:67,bridge_name='br-int',has_traffic_filtering=True,id=31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ae12cb-24') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31ae12cb-24, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edf84f7d-4e51-4414-9c06-21e0119fa7b9) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: INFO os_vif [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:92:67,bridge_name='br-int',has_traffic_filtering=True,id=31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ae12cb-24')
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyIjuaot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:08:22 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34a5b9-954c-474e-bb4a-a8f12cba9393]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:08:22 user nova-compute[75216]: No targets found.
Nov 02 05:08:22 user nova-compute[75216]: iSNS:
Nov 02 05:08:22 user nova-compute[75216]: No targets found.
Nov 02 05:08:22 user nova-compute[75216]: STATIC:
Nov 02 05:08:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816
Nov 02 05:08:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:08:22 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:08:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633
Nov 02 05:08:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:08:22 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:08:22 user nova-compute[75216]: FIRMWARE:
Nov 02 05:08:22 user nova-compute[75216]: No targets found.
Nov 02 05:08:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:08:22 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:08:22 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65f18ac-e7d6-47c4-938b-99665b1b5f13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d87a28-4f5e-4314-b312-0807f0c17405]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:08:22 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:08:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:08:22 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 (non-flash)
Nov 02 05:08:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4604155d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b8ef46-1a97-4977-b00a-199bf6ae6d9e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a5c52a-2788-456a-b2a3-569020825096]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ccfc58-360e-449c-bdd3-6f85b2a0bdfc]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9534f6c-9a7b-42a7-ab4f-6beb36400ea4]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2f947c3c-ac13db149a811e97',) {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 05:08:22 user nova-compute[75216]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2f947c3c-ac13db149a811e97
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa5a7d-620d-40cb-b411-0f26ae09f0a9]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23e181f-fd31-492e-b771-a24f89944130]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47921d23-085c-44e9-9133-743e90ead412]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260]
Nov 02 05:08:22 user nova-compute[75216]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816, portal: 172.16.0.220,3260] successful.
Nov 02 05:08:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:550e00de-1677-4bca-bd91-6de138b64816 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec9204e-8ee5-493d-9cad-ad4440a8a481]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.compute.manager [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Terminating instance
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== disconnect_volume: return (323ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Deleting instance files /opt/stack/data/nova/instances/1a50d6b8-242a-485a-9f1c-d3026bad949b_del
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Deletion of /opt/stack/data/nova/instances/1a50d6b8-242a-485a-9f1c-d3026bad949b_del complete
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.compute.manager [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 02 05:08:22 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Instance destroyed successfully.
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lazy-loading 'resources' on Instance uuid 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-362237143',display_name='tempest-VolumesNegativeTest-instance-362237143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-362237143',id=37,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:06:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9827da18f210448d81fef636c56fd317',ramdisk_id='',reservation_id='r-fr9efe1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1015352910',owner_user_name='tempest-VolumesNegativeTest-1015352910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:06:40Z,user_data=None,user_id='4b84115959cd4bdbb399cf64ff2496a0',uuid=1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Converting VIF {"id": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "address": "fa:16:3e:4d:cc:a4", "network": {"id": "daee3ad7-3d18-4536-a6f9-d424f27c8742", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "52eb3774d9184a69aef51b2780a0aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3e600c-97", "ovs_interfaceid": "8b3e600c-9730-4e84-bb8b-148e3f4591b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cc:a4,bridge_name='br-int',has_traffic_filtering=True,id=8b3e600c-9730-4e84-bb8b-148e3f4591b9,network=Network(daee3ad7-3d18-4536-a6f9-d424f27c8742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3e600c-97') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG os_vif [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cc:a4,bridge_name='br-int',has_traffic_filtering=True,id=8b3e600c-9730-4e84-bb8b-148e3f4591b9,network=Network(daee3ad7-3d18-4536-a6f9-d424f27c8742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3e600c-97') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b3e600c-97, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c02b60d1-ee4a-436c-8882-e64a6ac44411) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:22 user nova-compute[75216]: INFO os_vif [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cc:a4,bridge_name='br-int',has_traffic_filtering=True,id=8b3e600c-9730-4e84-bb8b-148e3f4591b9,network=Network(daee3ad7-3d18-4536-a6f9-d424f27c8742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3e600c-97')
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Deleting instance files /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a_del
Nov 02 05:08:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Deletion of /opt/stack/data/nova/instances/1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a_del complete
Nov 02 05:08:23 user nova-compute[75216]: INFO nova.compute.manager [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Acquiring lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] No waiting events found dispatching network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:23 user nova-compute[75216]: WARNING nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received unexpected event network-vif-plugged-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c for instance with vm_state active and task_state deleting.
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received event network-vif-unplugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Acquiring lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] No waiting events found dispatching network-vif-unplugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received event network-vif-unplugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received event network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Acquiring lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] No waiting events found dispatching network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:23 user nova-compute[75216]: WARNING nova.compute.manager [req-292d6a88-3955-4261-8e9d-0b69d89e1293 req-cab31f9f-c81f-457e-a0f9-75e24709f1cd service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received unexpected event network-vif-plugged-8b3e600c-9730-4e84-bb8b-148e3f4591b9 for instance with vm_state active and task_state deleting.
Nov 02 05:08:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:08:23 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Took 1.22 seconds to deallocate network for instance.
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid '1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid '1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a' (instance-00000025)
Nov 02 05:08:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-6a86eb40-096b-4e27-9ccf-58af7094b3c6 req-a48d6786-f843-4d4d-bb87-25563b87763c service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Received event network-vif-deleted-8b3e600c-9730-4e84-bb8b-148e3f4591b9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:24 user nova-compute[75216]: INFO nova.compute.manager [req-6a86eb40-096b-4e27-9ccf-58af7094b3c6 req-a48d6786-f843-4d4d-bb87-25563b87763c service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Neutron deleted interface 8b3e600c-9730-4e84-bb8b-148e3f4591b9; detaching it from the instance and deleting it from the info cache
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.network.neutron [req-6a86eb40-096b-4e27-9ccf-58af7094b3c6 req-a48d6786-f843-4d4d-bb87-25563b87763c service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:08:24 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Took 0.95 seconds to deallocate network for instance.
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-6a86eb40-096b-4e27-9ccf-58af7094b3c6 req-a48d6786-f843-4d4d-bb87-25563b87763c service nova] [instance: 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a] Detach interface failed, port_id=8b3e600c-9730-4e84-bb8b-148e3f4591b9, reason: Instance 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:24 user nova-compute[75216]: INFO nova.compute.manager [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Took 1.05 seconds to detach 1 volumes for instance.
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Deleting volume: 550e00de-1677-4bca-bd91-6de138b64816 {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 05:08:24 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:08:24 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8260MB free_disk=25.013103485107422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.663s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.089s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:24 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Deleted allocations for instance 1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1a50d6b8-242a-485a-9f1c-d3026bad949b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e60eecf5-3aca-45c4-8cd5-b577798465c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance d56f13bd-5050-4689-a0bd-b06c88db6252 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:08:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae0dd6e-fd9f-4e03-8e16-978d60ac5c55 tempest-VolumesNegativeTest-1015352910 tempest-VolumesNegativeTest-1015352910-project-member] Lock "1f9d5c8b-09c3-43dd-ac65-ad445b3eca4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.599s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.249s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:08:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:25 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Deleted allocations for instance 1a50d6b8-242a-485a-9f1c-d3026bad949b
Nov 02 05:08:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-52fbbf12-3ea2-439f-947d-708afcdc073a tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "1a50d6b8-242a-485a-9f1c-d3026bad949b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.223s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:25 user nova-compute[75216]: INFO nova.compute.manager [None req-c85d7e1f-69af-426a-b864-6bb77a29e335 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Get console output
Nov 02 05:08:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac3c6f75-56bc-46c8-ba9e-0307123701f4 req-27c64a5e-a771-4b24-bbac-c6a43e78be25 service nova] [instance: 1a50d6b8-242a-485a-9f1c-d3026bad949b] Received event network-vif-deleted-31ae12cb-24d8-4c3b-8b86-7b6d59f91f4c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:25 user nova-compute[75216]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 02 05:08:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:08:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid e99b36cc-571e-46d6-9a30-7aa3a0801ffd {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [{"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-e99b36cc-571e-46d6-9a30-7aa3a0801ffd" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:08:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:08:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:08:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:08:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:08:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-changed-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Refreshing instance network info cache due to event network-changed-bf8a785e-9ff6-4209-ab93-82c3c3adc396. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:08:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] Acquiring lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:08:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] Acquired lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:08:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Refreshing network info cache for port bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:08:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updated VIF entry in instance network info cache for port bf8a785e-9ff6-4209-ab93-82c3c3adc396. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:08:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updating instance_info_cache with network_info: [{"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:08:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2fcf39ee-fa6d-4e45-9472-2dcd96bbe1a8 req-a0071c10-b69d-44d3-8453-d3255738e937 service nova] Releasing lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'flavor' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:39 user nova-compute[75216]: INFO nova.compute.manager [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Attaching volume 14777fae-70d4-4e4b-8935-443fbc1766e4 to /dev/vdb
Nov 02 05:08:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35472c8e-9930-4b3f-a0b5-33f259c4864c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7517a97-bba6-4bfa-bb77-22b99859f07d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d61619-97c2-41d2-b95c-e954d127e798]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dbf5b6-924c-4b42-9649-fa832e043000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:08:39 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:08:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e09671-2de9-4972-99b3-2cde4a57dd21]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:08:39 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updating existing volume attachment record: d7199212-fd0f-4428-8239-2fc43b870011 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:08:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "d56f13bd-5050-4689-a0bd-b06c88db6252" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:44 user nova-compute[75216]: INFO nova.compute.manager [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Terminating instance
Nov 02 05:08:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-01d4429d-91e2-4af1-8ce6-4d35f0ee6425 req-81e1c912-f54b-4fa8-9810-c9e966232981 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received event network-vif-unplugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01d4429d-91e2-4af1-8ce6-4d35f0ee6425 req-81e1c912-f54b-4fa8-9810-c9e966232981 service nova] Acquiring lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01d4429d-91e2-4af1-8ce6-4d35f0ee6425 req-81e1c912-f54b-4fa8-9810-c9e966232981 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01d4429d-91e2-4af1-8ce6-4d35f0ee6425 req-81e1c912-f54b-4fa8-9810-c9e966232981 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-01d4429d-91e2-4af1-8ce6-4d35f0ee6425 req-81e1c912-f54b-4fa8-9810-c9e966232981 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] No waiting events found dispatching network-vif-unplugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-01d4429d-91e2-4af1-8ce6-4d35f0ee6425 req-81e1c912-f54b-4fa8-9810-c9e966232981 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received event network-vif-unplugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:08:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Instance destroyed successfully.
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lazy-loading 'resources' on Instance uuid d56f13bd-5050-4689-a0bd-b06c88db6252 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-640741757',display_name='tempest-VolumesActionsTest-instance-640741757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-640741757',id=39,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513adbd7b8f541febe9927ba78eee782',ramdisk_id='',reservation_id='r-r3u6fs04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-796192132',owner_user_name='tempest-VolumesActionsTest-796192132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:07:01Z,user_data=None,user_id='c0dd6755004247af9058fe05adcd950d',uuid=d56f13bd-5050-4689-a0bd-b06c88db6252,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converting VIF {"id": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "address": "fa:16:3e:3d:89:a2", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7d29f-ee", "ovs_interfaceid": "eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:89:a2,bridge_name='br-int',has_traffic_filtering=True,id=eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7d29f-ee') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG os_vif [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:89:a2,bridge_name='br-int',has_traffic_filtering=True,id=eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7d29f-ee') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb7d29f-ee, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9791c2a5-87f4-40d6-b9f3-c57ecbc377b0) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:45 user nova-compute[75216]: INFO os_vif [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:89:a2,bridge_name='br-int',has_traffic_filtering=True,id=eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7d29f-ee')
Nov 02 05:08:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Deleting instance files /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252_del
Nov 02 05:08:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Deletion of /opt/stack/data/nova/instances/d56f13bd-5050-4689-a0bd-b06c88db6252_del complete
Nov 02 05:08:45 user nova-compute[75216]: INFO nova.compute.manager [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 02 05:08:45 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:08:45 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Took 0.48 seconds to deallocate network for instance.
Nov 02 05:08:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-56cc94c9-d96a-4d1c-b864-19992a13da2d req-407845ca-a75c-4937-a8a6-cade427af73b service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received event network-vif-deleted-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:46 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Deleted allocations for instance d56f13bd-5050-4689-a0bd-b06c88db6252
Nov 02 05:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df430a02-8824-4e49-b890-5e60c7609cfb tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.761s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-c455c16b-b62f-4785-aa84-6e063551b977 req-3f0ce2d1-3f76-4c75-8524-ced5528ae9d7 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received event network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c455c16b-b62f-4785-aa84-6e063551b977 req-3f0ce2d1-3f76-4c75-8524-ced5528ae9d7 service nova] Acquiring lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c455c16b-b62f-4785-aa84-6e063551b977 req-3f0ce2d1-3f76-4c75-8524-ced5528ae9d7 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c455c16b-b62f-4785-aa84-6e063551b977 req-3f0ce2d1-3f76-4c75-8524-ced5528ae9d7 service nova] Lock "d56f13bd-5050-4689-a0bd-b06c88db6252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:08:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-c455c16b-b62f-4785-aa84-6e063551b977 req-3f0ce2d1-3f76-4c75-8524-ced5528ae9d7 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] No waiting events found dispatching network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:08:46 user nova-compute[75216]: WARNING nova.compute.manager [req-c455c16b-b62f-4785-aa84-6e063551b977 req-3f0ce2d1-3f76-4c75-8524-ced5528ae9d7 service nova] [instance: d56f13bd-5050-4689-a0bd-b06c88db6252] Received unexpected event network-vif-plugged-eeb7d29f-ee80-48a8-99e1-b68bc3e3cd12 for instance with vm_state deleted and task_state None.
Nov 02 05:08:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:08:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:08:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:09:04 user nova-compute[75216]: INFO nova.compute.claims [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Claim successful on node user
Nov 02 05:09:04 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:09:04 user nova-compute[75216]: DEBUG nova.network.neutron [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:09:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:09:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Creating image(s)
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.policy [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049f40a6f12742aaa3192675b09644a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca67de068e45497ba3286b5c50da9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk 1073741824" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Successfully created port: 469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Cannot resize image /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Successfully updated port: 469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquired lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-changed-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing instance network info cache due to event network-changed-469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] Acquiring lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Releasing lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance network_info: |[{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] Acquired lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.network.neutron [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:09:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Start _get_guest_xml network_info=[{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:09:06 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:06 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-572366251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-572366251',id=41,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgGW7yb4icMqF0naGl12n9jNQKOz1BnQrpbCXIwCkukV0UuDJ05ZpTXSEtqOmUmdxm/buWQd/ojVUrl/WLxM/YN1W/OBdYXk/49Roibr2rM2z85bm3DtA+aueFHdpTXYQ==',key_name='tempest-keypair-2031242040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-b3w5h0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=0ed080f2-eb48-45ce-b67b-4949672c93d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.objects.instance [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:09:07 user nova-compute[75216]:   <uuid>0ed080f2-eb48-45ce-b67b-4949672c93d4</uuid>
Nov 02 05:09:07 user nova-compute[75216]:   <name>instance-00000029</name>
Nov 02 05:09:07 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:09:07 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:09:07 user nova-compute[75216]:   <metadata>
Nov 02 05:09:07 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:09:07 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:09:07 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-572366251</nova:name>
Nov 02 05:09:07 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:09:06</nova:creationTime>
Nov 02 05:09:07 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:09:07 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:09:07 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:09:07 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:09:07 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:09:07 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:09:07 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:09:07 user nova-compute[75216]:       <nova:owner>
Nov 02 05:09:07 user nova-compute[75216]:         <nova:user uuid="049f40a6f12742aaa3192675b09644a6">tempest-AttachVolumeShelveTestJSON-1661619051-project-member</nova:user>
Nov 02 05:09:07 user nova-compute[75216]:         <nova:project uuid="ca67de068e45497ba3286b5c50da9335">tempest-AttachVolumeShelveTestJSON-1661619051</nova:project>
Nov 02 05:09:07 user nova-compute[75216]:       </nova:owner>
Nov 02 05:09:07 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:09:07 user nova-compute[75216]:       <nova:ports>
Nov 02 05:09:07 user nova-compute[75216]:         <nova:port uuid="469ad201-023b-4826-b3c1-4464db75bad2">
Nov 02 05:09:07 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 05:09:07 user nova-compute[75216]:         </nova:port>
Nov 02 05:09:07 user nova-compute[75216]:       </nova:ports>
Nov 02 05:09:07 user nova-compute[75216]:     </nova:instance>
Nov 02 05:09:07 user nova-compute[75216]:   </metadata>
Nov 02 05:09:07 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:09:07 user nova-compute[75216]:     <system>
Nov 02 05:09:07 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:09:07 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:09:07 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:09:07 user nova-compute[75216]:       <entry name="serial">0ed080f2-eb48-45ce-b67b-4949672c93d4</entry>
Nov 02 05:09:07 user nova-compute[75216]:       <entry name="uuid">0ed080f2-eb48-45ce-b67b-4949672c93d4</entry>
Nov 02 05:09:07 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:09:07 user nova-compute[75216]:     </system>
Nov 02 05:09:07 user nova-compute[75216]:   </sysinfo>
Nov 02 05:09:07 user nova-compute[75216]:   <os>
Nov 02 05:09:07 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:09:07 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:09:07 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:09:07 user nova-compute[75216]:   </os>
Nov 02 05:09:07 user nova-compute[75216]:   <features>
Nov 02 05:09:07 user nova-compute[75216]:     <acpi/>
Nov 02 05:09:07 user nova-compute[75216]:     <apic/>
Nov 02 05:09:07 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:09:07 user nova-compute[75216]:   </features>
Nov 02 05:09:07 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:09:07 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:09:07 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:09:07 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:09:07 user nova-compute[75216]:   </clock>
Nov 02 05:09:07 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:09:07 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:09:07 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:09:07 user nova-compute[75216]:   </cpu>
Nov 02 05:09:07 user nova-compute[75216]:   <devices>
Nov 02 05:09:07 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:09:07 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:09:07 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk"/>
Nov 02 05:09:07 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:09:07 user nova-compute[75216]:     </disk>
Nov 02 05:09:07 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:09:07 user nova-compute[75216]:       <mac address="fa:16:3e:d0:a0:cc"/>
Nov 02 05:09:07 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:07 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:09:07 user nova-compute[75216]:       <target dev="tap469ad201-02"/>
Nov 02 05:09:07 user nova-compute[75216]:     </interface>
Nov 02 05:09:07 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:09:07 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/console.log" append="off"/>
Nov 02 05:09:07 user nova-compute[75216]:     </serial>
Nov 02 05:09:07 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:09:07 user nova-compute[75216]:     <video>
Nov 02 05:09:07 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:07 user nova-compute[75216]:     </video>
Nov 02 05:09:07 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:09:07 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:09:07 user nova-compute[75216]:     </rng>
Nov 02 05:09:07 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:09:07 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:09:07 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:09:07 user nova-compute[75216]:     </memballoon>
Nov 02 05:09:07 user nova-compute[75216]:   </devices>
Nov 02 05:09:07 user nova-compute[75216]: </domain>
Nov 02 05:09:07 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-572366251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-572366251',id=41,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgGW7yb4icMqF0naGl12n9jNQKOz1BnQrpbCXIwCkukV0UuDJ05ZpTXSEtqOmUmdxm/buWQd/ojVUrl/WLxM/YN1W/OBdYXk/49Roibr2rM2z85bm3DtA+aueFHdpTXYQ==',key_name='tempest-keypair-2031242040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-b3w5h0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=0ed080f2-eb48-45ce-b67b-4949672c93d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG os_vif [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8c1c891-a00b-59e7-8245-6fe5d7d8c32e', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469ad201-02, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap469ad201-02, col_values=(('qos', UUID('1b5aaa8a-c6ef-44d1-9b05-813a976bcd00')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap469ad201-02, col_values=(('external_ids', {'iface-id': '469ad201-023b-4826-b3c1-4464db75bad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:a0:cc', 'vm-uuid': '0ed080f2-eb48-45ce-b67b-4949672c93d4'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:07 user nova-compute[75216]: INFO os_vif [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02')
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No VIF found with MAC fa:16:3e:d0:a0:cc, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updated VIF entry in instance network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81c1533f-be9d-4b50-a95b-88fe0328c0b2 req-fb728283-9ca4-4cec-8e38-997df8270fd1 service nova] Releasing lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-5838bb92-4c73-4939-b753-2dc6b255dec1 req-41e0ba18-05b2-4531-a406-a30e8982cf3f service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5838bb92-4c73-4939-b753-2dc6b255dec1 req-41e0ba18-05b2-4531-a406-a30e8982cf3f service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5838bb92-4c73-4939-b753-2dc6b255dec1 req-41e0ba18-05b2-4531-a406-a30e8982cf3f service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5838bb92-4c73-4939-b753-2dc6b255dec1 req-41e0ba18-05b2-4531-a406-a30e8982cf3f service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-5838bb92-4c73-4939-b753-2dc6b255dec1 req-41e0ba18-05b2-4531-a406-a30e8982cf3f service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:09:08 user nova-compute[75216]: WARNING nova.compute.manager [req-5838bb92-4c73-4939-b753-2dc6b255dec1 req-41e0ba18-05b2-4531-a406-a30e8982cf3f service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received unexpected event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with vm_state building and task_state spawning.
Nov 02 05:09:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:09:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance spawned successfully.
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:10 user nova-compute[75216]: INFO nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-9436378d-9e77-46c1-888b-c2e24793cf2f req-ccf948a4-f38b-4cf2-a3e3-6fd8a41ad01c service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9436378d-9e77-46c1-888b-c2e24793cf2f req-ccf948a4-f38b-4cf2-a3e3-6fd8a41ad01c service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9436378d-9e77-46c1-888b-c2e24793cf2f req-ccf948a4-f38b-4cf2-a3e3-6fd8a41ad01c service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9436378d-9e77-46c1-888b-c2e24793cf2f req-ccf948a4-f38b-4cf2-a3e3-6fd8a41ad01c service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-9436378d-9e77-46c1-888b-c2e24793cf2f req-ccf948a4-f38b-4cf2-a3e3-6fd8a41ad01c service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:09:10 user nova-compute[75216]: WARNING nova.compute.manager [req-9436378d-9e77-46c1-888b-c2e24793cf2f req-ccf948a4-f38b-4cf2-a3e3-6fd8a41ad01c service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received unexpected event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with vm_state building and task_state spawning.
Nov 02 05:09:10 user nova-compute[75216]: INFO nova.compute.manager [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Took 6.17 seconds to build instance.
Nov 02 05:09:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-877b367e-b641-447b-8751-5b78039add57 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.269s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izkZhgxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:09:16 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:09:16 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:09:16 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4147a1-d606-48b8-974b-4e2416bd4734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:09:16 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40f9f6-a8c7-49fb-9d0c-9dbf64faaf8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4] added
Nov 02 05:09:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[122f7200-d80b-4187-99cc-866ae3d74caf]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3b5400-940f-4dae-bf61-733ec7ce0b04]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v izkZhgxA {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v izkZhgxA" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0172e62b-608d-4300-9293-3f17dda5abc7]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'izkZhgxA'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9875652-b57e-44e3-83c2-209998fff111]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610d917-2f81-4060-8418-22e8c5ea4e3e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:09:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:09:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbab573c-30e3-452f-a4db-efb6f0549e81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260]
Nov 02 05:09:16 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260] successful.
Nov 02 05:09:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a06734-41f8-4df3-b741-1136eae00ffd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[842217fc-c328-46cb-958e-04d62cfc39f5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:09:16 user nova-compute[75216]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:09:16 user nova-compute[75216]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:16 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d270322-091f-4d16-8b5a-a7e4c7936a46]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:09:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izkZhgxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:09:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:09:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26161666166623361', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:09:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161666166623361', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:09:17 user nova-compute[75216]: DEBUG nova.objects.instance [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'flavor' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:09:17 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:09:17 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 05:09:17 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:09:17 user nova-compute[75216]:   <serial>14777fae-70d4-4e4b-8935-443fbc1766e4</serial>
Nov 02 05:09:17 user nova-compute[75216]: </disk>
Nov 02 05:09:17 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:09:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No VIF found with MAC fa:16:3e:fb:f5:37, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:09:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-001103a1-59ed-4d95-b6e0-254af5235813 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.996s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'flavor' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:22 user nova-compute[75216]: INFO nova.compute.manager [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Attaching volume 861839bb-fc15-4bb8-9938-f9410c86c30a to /dev/vdc
Nov 02 05:09:22 user nova-compute[75216]: DEBUG os_brick.utils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[19110eff-20a5-4b96-be2e-045b3d2dc28d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e38b2-24f4-462c-b083-d033974d31f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d10790-a464-4b1d-bad6-621c26663b2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dea3b7-6c90-4d69-aaa8-0b40884bd117]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:09:22 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:09:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[06528f39-0288-42fc-877b-91b5b4edda5a]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG os_brick.utils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:09:22 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updating existing volume attachment record: 35fe9974-cc8b-4879-b06f-dad665e18992 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8258MB free_disk=25.064071655273438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e60eecf5-3aca-45c4-8cd5-b577798465c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0ed080f2-eb48-45ce-b67b-4949672c93d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:09:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:26 user nova-compute[75216]: INFO nova.compute.manager [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Terminating instance
Nov 02 05:09:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-7311ed2e-0e1d-4498-b5c8-ffef0b8e0c88 req-89591eea-cc92-4a71-adf4-f56e8cf2b4f1 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-unplugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7311ed2e-0e1d-4498-b5c8-ffef0b8e0c88 req-89591eea-cc92-4a71-adf4-f56e8cf2b4f1 service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7311ed2e-0e1d-4498-b5c8-ffef0b8e0c88 req-89591eea-cc92-4a71-adf4-f56e8cf2b4f1 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7311ed2e-0e1d-4498-b5c8-ffef0b8e0c88 req-89591eea-cc92-4a71-adf4-f56e8cf2b4f1 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-7311ed2e-0e1d-4498-b5c8-ffef0b8e0c88 req-89591eea-cc92-4a71-adf4-f56e8cf2b4f1 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-unplugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-7311ed2e-0e1d-4498-b5c8-ffef0b8e0c88 req-89591eea-cc92-4a71-adf4-f56e8cf2b4f1 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-unplugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Instance destroyed successfully.
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'resources' on Instance uuid e60eecf5-3aca-45c4-8cd5-b577798465c3 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1065672926',display_name='tempest-ServerActionsTestOtherA-server-1065672926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1065672926',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-jkfxu5rl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e60eecf5-3aca-45c4-8cd5-b577798465c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "address": "fa:16:3e:7e:19:49", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bea3e1d-30", "ovs_interfaceid": "9bea3e1d-3045-42bb-ab41-922d00e5f351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_vif [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bea3e1d-30, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89d0cbcc-2f54-4787-b2b6-d2fad97c21ae) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:27 user nova-compute[75216]: INFO os_vif [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:19:49,bridge_name='br-int',has_traffic_filtering=True,id=9bea3e1d-3045-42bb-ab41-922d00e5f351,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bea3e1d-30')
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqmfXAYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:09:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf8fec5-76f7-4a85-8d0f-45d247657def]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:09:27 user nova-compute[75216]: No targets found.
Nov 02 05:09:27 user nova-compute[75216]: iSNS:
Nov 02 05:09:27 user nova-compute[75216]: No targets found.
Nov 02 05:09:27 user nova-compute[75216]: STATIC:
Nov 02 05:09:27 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4
Nov 02 05:09:27 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:09:27 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:09:27 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633
Nov 02 05:09:27 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:09:27 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:09:27 user nova-compute[75216]: FIRMWARE:
Nov 02 05:09:27 user nova-compute[75216]: No targets found.
Nov 02 05:09:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:09:27 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:09:27 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4e5286-4ad2-4005-be00-41194c7159e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88d9739-2750-4e63-b4c1-1eb5fcb86149]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:09:27 user nova-compute[75216]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 (non-flash)
Nov 02 05:09:27 user nova-compute[75216]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec342560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4376219-7408-4fdf-9fd8-848b8f8f8097]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d65e0a-7559-4c6c-9ede-5f1a34b62018]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[691bf9d6-1cf0-427d-acd8-f4db7f3f374d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.095s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dca427-0a77-4cd9-8781-e9b7beb9a241]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.079s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1c7071-a414-4927-a06a-4d4401f6cfc6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec3af1-39f9-4aa6-93f4-9bf7a1790b1d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260]
Nov 02 05:09:27 user nova-compute[75216]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633, portal: 172.16.0.220,3260] successful.
Nov 02 05:09:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2025b22e-d7d6-4daf-b58f-3ca28aefe633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f212c8e6-c804-4fe1-8a37-4e6a57d78c5b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] <== disconnect_volume: return (471ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:09:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Deleting instance files /opt/stack/data/nova/instances/e60eecf5-3aca-45c4-8cd5-b577798465c3_del
Nov 02 05:09:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Deletion of /opt/stack/data/nova/instances/e60eecf5-3aca-45c4-8cd5-b577798465c3_del complete
Nov 02 05:09:27 user nova-compute[75216]: INFO nova.compute.manager [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 02 05:09:27 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:09:27 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:28 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Took 0.93 seconds to deallocate network for instance.
Nov 02 05:09:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d58f889-1e85-47cc-bbb1-4fb9b9cd1921 req-4b6006b4-3fb9-4ea3-afcb-ddd7b8c36702 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d58f889-1e85-47cc-bbb1-4fb9b9cd1921 req-4b6006b4-3fb9-4ea3-afcb-ddd7b8c36702 service nova] Acquiring lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d58f889-1e85-47cc-bbb1-4fb9b9cd1921 req-4b6006b4-3fb9-4ea3-afcb-ddd7b8c36702 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d58f889-1e85-47cc-bbb1-4fb9b9cd1921 req-4b6006b4-3fb9-4ea3-afcb-ddd7b8c36702 service nova] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d58f889-1e85-47cc-bbb1-4fb9b9cd1921 req-4b6006b4-3fb9-4ea3-afcb-ddd7b8c36702 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] No waiting events found dispatching network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:09:28 user nova-compute[75216]: WARNING nova.compute.manager [req-6d58f889-1e85-47cc-bbb1-4fb9b9cd1921 req-4b6006b4-3fb9-4ea3-afcb-ddd7b8c36702 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received unexpected event network-vif-plugged-9bea3e1d-3045-42bb-ab41-922d00e5f351 for instance with vm_state active and task_state deleting.
Nov 02 05:09:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d58f889-1e85-47cc-bbb1-4fb9b9cd1921 req-4b6006b4-3fb9-4ea3-afcb-ddd7b8c36702 service nova] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Received event network-vif-deleted-9bea3e1d-3045-42bb-ab41-922d00e5f351 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Skipping network cache update for instance because it is being deleted. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:09:29 user nova-compute[75216]: INFO nova.compute.manager [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Took 0.91 seconds to detach 1 volumes for instance.
Nov 02 05:09:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e60eecf5-3aca-45c4-8cd5-b577798465c3] Deleting volume: 2025b22e-d7d6-4daf-b58f-3ca28aefe633 {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:30 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:09:30 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:09:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:30 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Deleted allocations for instance e60eecf5-3aca-45c4-8cd5-b577798465c3
Nov 02 05:09:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8840eff2-507f-4b23-a62d-b9269eb9ded0 tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e60eecf5-3aca-45c4-8cd5-b577798465c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.802s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updating instance_info_cache with network_info: [{"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-6eb5bdfc-4edd-409c-b228-f557b1aac60e" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:09:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "72d2b252-e597-49dd-ad25-ac0790a31613" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:09:34 user nova-compute[75216]: INFO nova.compute.claims [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Claim successful on node user
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:09:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.policy [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94f0b01ce0c744bdbb937e0a477dcf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eeaefe9a0e4468d9bbb99ba3aca7c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:09:34 user nova-compute[75216]: INFO nova.virt.block_device [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Booting with volume ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a at /dev/vda
Nov 02 05:09:34 user nova-compute[75216]: DEBUG os_brick.utils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b5fcd-48d3-40c1-a802-e778cde851df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04956b58-cae4-4cd7-bccc-1f7613d31e5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4971ad-411d-4e0e-96b9-d9c2c64c95e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6099bf60-9586-481a-9172-796ff322e386]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:09:34 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:09:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3df23-bc7f-4201-ab91-d1cb2ab07c00]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG os_brick.utils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:09:34 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Updating existing volume attachment record: dbc64753-e6cc-47eb-8618-edf253654d8b {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:09:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Successfully created port: 6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:09:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Successfully updated port: 6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:09:36 user nova-compute[75216]: INFO nova.compute.claims [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Claim successful on node user
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquired lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-changed-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Refreshing instance network info cache due to event network-changed-6837405c-3968-4c95-80fc-0c1e063e2e8f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] Acquiring lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Updating instance_info_cache with network_info: [{"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Releasing lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Instance network_info: |[{"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] Acquired lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Refreshing network info cache for port 6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:09:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.policy [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0dd6755004247af9058fe05adcd950d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513adbd7b8f541febe9927ba78eee782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:09:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Creating image(s)
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "/opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "/opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "/opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Updated VIF entry in instance network info cache for port 6837405c-3968-4c95-80fc-0c1e063e2e8f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Updating instance_info_cache with network_info: [{"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db135764-3f94-431b-97e7-e24d2a6dab7c req-9a229fa1-18f3-478e-870f-de8e3b924582 service nova] Releasing lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk 1073741824" returned: 0 in 0.060s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Successfully created port: 3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Cannot resize image /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Ensure instance console log exists: /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Successfully updated port: 3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "refresh_cache-a69aa2eb-70c9-4c93-8cba-63728feecab2" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquired lock "refresh_cache-a69aa2eb-70c9-4c93-8cba-63728feecab2" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received event network-changed-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Refreshing instance network info cache due to event network-changed-3b313b59-b166-4228-bd2e-a2a96443ebe9. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] Acquiring lock "refresh_cache-a69aa2eb-70c9-4c93-8cba-63728feecab2" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Updating instance_info_cache with network_info: [{"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Releasing lock "refresh_cache-a69aa2eb-70c9-4c93-8cba-63728feecab2" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Instance network_info: |[{"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] Acquired lock "refresh_cache-a69aa2eb-70c9-4c93-8cba-63728feecab2" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Refreshing network info cache for port 3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Start _get_guest_xml network_info=[{"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:09:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-742495288',display_name='tempest-VolumesActionsTest-instance-742495288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-742495288',id=43,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513adbd7b8f541febe9927ba78eee782',ramdisk_id='',reservation_id='r-y2pbdrxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-796192132',owner_user_name='tempest-VolumesActionsTest-796192132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:37Z,user_data=None,user_id='c0dd6755004247af9058fe05adcd950d',uuid=a69aa2eb-70c9-4c93-8cba-63728feecab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converting VIF {"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:68,bridge_name='br-int',has_traffic_filtering=True,id=3b313b59-b166-4228-bd2e-a2a96443ebe9,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b313b59-b1') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lazy-loading 'pci_devices' on Instance uuid a69aa2eb-70c9-4c93-8cba-63728feecab2 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:09:38 user nova-compute[75216]:   <uuid>a69aa2eb-70c9-4c93-8cba-63728feecab2</uuid>
Nov 02 05:09:38 user nova-compute[75216]:   <name>instance-0000002b</name>
Nov 02 05:09:38 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:09:38 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:09:38 user nova-compute[75216]:   <metadata>
Nov 02 05:09:38 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:09:38 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:09:38 user nova-compute[75216]:       <nova:name>tempest-VolumesActionsTest-instance-742495288</nova:name>
Nov 02 05:09:38 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:09:38</nova:creationTime>
Nov 02 05:09:38 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:09:38 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:09:38 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:09:38 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:09:38 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:09:38 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:09:38 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:09:38 user nova-compute[75216]:       <nova:owner>
Nov 02 05:09:38 user nova-compute[75216]:         <nova:user uuid="c0dd6755004247af9058fe05adcd950d">tempest-VolumesActionsTest-796192132-project-member</nova:user>
Nov 02 05:09:38 user nova-compute[75216]:         <nova:project uuid="513adbd7b8f541febe9927ba78eee782">tempest-VolumesActionsTest-796192132</nova:project>
Nov 02 05:09:38 user nova-compute[75216]:       </nova:owner>
Nov 02 05:09:38 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:09:38 user nova-compute[75216]:       <nova:ports>
Nov 02 05:09:38 user nova-compute[75216]:         <nova:port uuid="3b313b59-b166-4228-bd2e-a2a96443ebe9">
Nov 02 05:09:38 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 05:09:38 user nova-compute[75216]:         </nova:port>
Nov 02 05:09:38 user nova-compute[75216]:       </nova:ports>
Nov 02 05:09:38 user nova-compute[75216]:     </nova:instance>
Nov 02 05:09:38 user nova-compute[75216]:   </metadata>
Nov 02 05:09:38 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:09:38 user nova-compute[75216]:     <system>
Nov 02 05:09:38 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:09:38 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:09:38 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:09:38 user nova-compute[75216]:       <entry name="serial">a69aa2eb-70c9-4c93-8cba-63728feecab2</entry>
Nov 02 05:09:38 user nova-compute[75216]:       <entry name="uuid">a69aa2eb-70c9-4c93-8cba-63728feecab2</entry>
Nov 02 05:09:38 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:09:38 user nova-compute[75216]:     </system>
Nov 02 05:09:38 user nova-compute[75216]:   </sysinfo>
Nov 02 05:09:38 user nova-compute[75216]:   <os>
Nov 02 05:09:38 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:09:38 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:09:38 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:09:38 user nova-compute[75216]:   </os>
Nov 02 05:09:38 user nova-compute[75216]:   <features>
Nov 02 05:09:38 user nova-compute[75216]:     <acpi/>
Nov 02 05:09:38 user nova-compute[75216]:     <apic/>
Nov 02 05:09:38 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:09:38 user nova-compute[75216]:   </features>
Nov 02 05:09:38 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:09:38 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:09:38 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:09:38 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:09:38 user nova-compute[75216]:   </clock>
Nov 02 05:09:38 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:09:38 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:09:38 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:09:38 user nova-compute[75216]:   </cpu>
Nov 02 05:09:38 user nova-compute[75216]:   <devices>
Nov 02 05:09:38 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:09:38 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:09:38 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk"/>
Nov 02 05:09:38 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:09:38 user nova-compute[75216]:     </disk>
Nov 02 05:09:38 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:09:38 user nova-compute[75216]:       <mac address="fa:16:3e:30:3d:68"/>
Nov 02 05:09:38 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:38 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:09:38 user nova-compute[75216]:       <target dev="tap3b313b59-b1"/>
Nov 02 05:09:38 user nova-compute[75216]:     </interface>
Nov 02 05:09:38 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:09:38 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/console.log" append="off"/>
Nov 02 05:09:38 user nova-compute[75216]:     </serial>
Nov 02 05:09:38 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:09:38 user nova-compute[75216]:     <video>
Nov 02 05:09:38 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:38 user nova-compute[75216]:     </video>
Nov 02 05:09:38 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:09:38 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:09:38 user nova-compute[75216]:     </rng>
Nov 02 05:09:38 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:09:38 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:09:38 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:09:38 user nova-compute[75216]:     </memballoon>
Nov 02 05:09:38 user nova-compute[75216]:   </devices>
Nov 02 05:09:38 user nova-compute[75216]: </domain>
Nov 02 05:09:38 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-742495288',display_name='tempest-VolumesActionsTest-instance-742495288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-742495288',id=43,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513adbd7b8f541febe9927ba78eee782',ramdisk_id='',reservation_id='r-y2pbdrxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-796192132',owner_user_name='tempest-VolumesActionsTest-796192132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:37Z,user_data=None,user_id='c0dd6755004247af9058fe05adcd950d',uuid=a69aa2eb-70c9-4c93-8cba-63728feecab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converting VIF {"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:68,bridge_name='br-int',has_traffic_filtering=True,id=3b313b59-b166-4228-bd2e-a2a96443ebe9,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b313b59-b1') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG os_vif [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:68,bridge_name='br-int',has_traffic_filtering=True,id=3b313b59-b166-4228-bd2e-a2a96443ebe9,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b313b59-b1') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81634571-c8e6-54c3-a275-55db261bae89', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b313b59-b1, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b313b59-b1, col_values=(('qos', UUID('4dfb17eb-81e9-4ba4-a1a5-ef3f8082f6c0')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b313b59-b1, col_values=(('external_ids', {'iface-id': '3b313b59-b166-4228-bd2e-a2a96443ebe9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:3d:68', 'vm-uuid': 'a69aa2eb-70c9-4c93-8cba-63728feecab2'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:38 user nova-compute[75216]: INFO os_vif [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:68,bridge_name='br-int',has_traffic_filtering=True,id=3b313b59-b166-4228-bd2e-a2a96443ebe9,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b313b59-b1')
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] No VIF found with MAC fa:16:3e:30:3d:68, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Updated VIF entry in instance network info cache for port 3b313b59-b166-4228-bd2e-a2a96443ebe9. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Updating instance_info_cache with network_info: [{"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-26a07d45-13f2-42b8-99b1-bf57ad3b16b5 req-e816783e-cfad-4077-974f-c6e16ed1cbec service nova] Releasing lock "refresh_cache-a69aa2eb-70c9-4c93-8cba-63728feecab2" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-0461c82c-40c3-484a-8422-4e0e3d946177 req-768580ea-b442-4a34-9b84-bd2fb3c0be8b service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received event network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0461c82c-40c3-484a-8422-4e0e3d946177 req-768580ea-b442-4a34-9b84-bd2fb3c0be8b service nova] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0461c82c-40c3-484a-8422-4e0e3d946177 req-768580ea-b442-4a34-9b84-bd2fb3c0be8b service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0461c82c-40c3-484a-8422-4e0e3d946177 req-768580ea-b442-4a34-9b84-bd2fb3c0be8b service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-0461c82c-40c3-484a-8422-4e0e3d946177 req-768580ea-b442-4a34-9b84-bd2fb3c0be8b service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] No waiting events found dispatching network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:09:40 user nova-compute[75216]: WARNING nova.compute.manager [req-0461c82c-40c3-484a-8422-4e0e3d946177 req-768580ea-b442-4a34-9b84-bd2fb3c0be8b service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received unexpected event network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 for instance with vm_state building and task_state spawning.
Nov 02 05:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-a8757ded-be2c-4088-a2b2-6cbfb4526c4d req-ead19a20-265a-440b-86c4-78137f9643dd service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received event network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a8757ded-be2c-4088-a2b2-6cbfb4526c4d req-ead19a20-265a-440b-86c4-78137f9643dd service nova] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a8757ded-be2c-4088-a2b2-6cbfb4526c4d req-ead19a20-265a-440b-86c4-78137f9643dd service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a8757ded-be2c-4088-a2b2-6cbfb4526c4d req-ead19a20-265a-440b-86c4-78137f9643dd service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-a8757ded-be2c-4088-a2b2-6cbfb4526c4d req-ead19a20-265a-440b-86c4-78137f9643dd service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] No waiting events found dispatching network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:09:42 user nova-compute[75216]: WARNING nova.compute.manager [req-a8757ded-be2c-4088-a2b2-6cbfb4526c4d req-ead19a20-265a-440b-86c4-78137f9643dd service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received unexpected event network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 for instance with vm_state building and task_state spawning.
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:09:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Instance spawned successfully.
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:09:42 user nova-compute[75216]: INFO nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 02 05:09:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:09:42 user nova-compute[75216]: INFO nova.compute.manager [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Took 6.48 seconds to build instance.
Nov 02 05:09:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e34fcc58-25e1-44d1-b7de-06210be25ac3 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.602s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRbMerzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:09:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:09:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:09:44 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ddb75-dd7d-40d2-b86e-0282cbc58185]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:09:44 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d5362e-ea7e-4c30-9540-15210335f589]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a] added
Nov 02 05:09:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6339cab-dc91-419d-ae55-5210dec0c2c6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36a5d6d-5dac-4595-90f9-6b29bebc5c93]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRbMerzl {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRbMerzl" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b75a656-8d1f-4ed8-b906-e7f941aab8a1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SRbMerzl'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d3cb4c-86db-4198-80e8-a8f1e414f236]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a625ac-4513-4590-83bc-819c79619f5a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b55ba8-28d9-429f-8d61-e8aa8c1c61ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260]
Nov 02 05:09:44 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260] successful.
Nov 02 05:09:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f1b699-f125-4c93-990d-3b9768a91827]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77025b6-d0c3-4385-9265-38a8a5b4c490]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:44 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:09:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:44 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:09:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ecea3-1066-4fa5-b005-029b903a6141]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:09:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRbMerzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:09:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:09:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26366343861386565', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:09:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366343861386565', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:09:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'flavor' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:09:45 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:09:45 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:09:45 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 05:09:45 user nova-compute[75216]:   <serial>861839bb-fc15-4bb8-9938-f9410c86c30a</serial>
Nov 02 05:09:45 user nova-compute[75216]: </disk>
Nov 02 05:09:45 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:09:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] No VIF found with MAC fa:16:3e:fb:f5:37, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:09:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-865ebf26-56c3-4d4b-8745-f17884476b57 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.189s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:09:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:47 user nova-compute[75216]: INFO nova.compute.manager [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Detaching volume 861839bb-fc15-4bb8-9938-f9410c86c30a
Nov 02 05:09:47 user nova-compute[75216]: INFO nova.virt.block_device [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Attempting to driver detach volume 861839bb-fc15-4bb8-9938-f9410c86c30a from mountpoint /dev/vdc
Nov 02 05:09:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Attempting to detach device vdc from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:09:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:09:47 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:09:47 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:09:47 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 05:09:47 user nova-compute[75216]:   <serial>861839bb-fc15-4bb8-9938-f9410c86c30a</serial>
Nov 02 05:09:47 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 05:09:47 user nova-compute[75216]: </disk>
Nov 02 05:09:47 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:09:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Successfully detached device vdc from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the persistent domain config.
Nov 02 05:09:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:09:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:09:47 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:09:47 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:09:47 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 02 05:09:47 user nova-compute[75216]:   <serial>861839bb-fc15-4bb8-9938-f9410c86c30a</serial>
Nov 02 05:09:47 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 05:09:47 user nova-compute[75216]: </disk>
Nov 02 05:09:47 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:09:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:09:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:09:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:09:55 user nova-compute[75216]: INFO nova.compute.claims [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Claim successful on node user
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:09:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.policy [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a60b807f9454e49917d372178cc196f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bbd2a0fea340eda045059153a3ed9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:09:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Creating image(s)
Nov 02 05:09:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "/opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "/opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "/opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "b17dd39d667d263a78bdf850b6c615d3cbb05e42" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "b17dd39d667d263a78bdf850b6c615d3cbb05e42" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Successfully created port: 854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.images [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] 416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.part /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:09:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Creating image(s)
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Ensure instance console log exists: /opt/stack/data/nova/instances/72d2b252-e597-49dd-ad25-ac0790a31613/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Start _get_guest_xml network_info=[{"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'dbc64753-e6cc-47eb-8618-edf253654d8b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72d2b252-e597-49dd-ad25-ac0790a31613', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'serial': 'ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:09:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:09:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:09:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:09:57 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5376c6-9989-455a-97a0-927b3a0bdd85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:09:57 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c159a7-5f30-4981-9859-0770d2276ce5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a] added
Nov 02 05:09:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e7287-aa5a-4617-a396-29ce94045c64]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71001d6-23f4-4e8a-aab6-5cc7e94a5a56]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFvxXPCT {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFvxXPCT" returned: 0 in 0.070s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[557720cf-fc14-4113-b839-0a5df1df9f1b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AFvxXPCT'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.part /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.converted" returned: 0 in 0.380s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[02319dbf-e383-4c23-b568-2c79fbb8c738]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5464c2-3d68-4a64-8c67-b8884d78255a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:57 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:09:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:57 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:09:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ec903-e056-44a2-a12b-43f46d782de3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]
Nov 02 05:09:57 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.
Nov 02 05:09:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ffeae-2134-4487-9fde-35dfd2bc1b17]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af346d6-7399-4e4e-a93a-bd82e250dfe5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:57 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:09:57 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:09:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:09:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:09:57 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:09:57 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:09:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "b17dd39d667d263a78bdf850b6c615d3cbb05e42" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.423s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0947540-77e1-41f0-952e-4470f4f8ac31]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "b17dd39d667d263a78bdf850b6c615d3cbb05e42" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "b17dd39d667d263a78bdf850b6c615d3cbb05e42" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42,backing_fmt=raw /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Successfully updated port: 854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42,backing_fmt=raw /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk 1073741824" returned: 0 in 0.049s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "b17dd39d667d263a78bdf850b6c615d3cbb05e42" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-changed-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing instance network info cache due to event network-changed-854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Cannot resize image /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Ensure instance console log exists: /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance network_info: |[{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing network info cache for port 854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Start _get_guest_xml network_info=[{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T05:09:53Z,direct_url=<?>,disk_format='qcow2',id=416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb,min_disk=0,min_ram=0,name='tempest-scenario-img--1681059844',owner='e0bbd2a0fea340eda045059153a3ed9f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T05:09:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:09:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T05:09:53Z,direct_url=<?>,disk_format='qcow2',id=416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb,min_disk=0,min_ram=0,name='tempest-scenario-img--1681059844',owner='e0bbd2a0fea340eda045059153a3ed9f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T05:09:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-212758906',display_name='tempest-TestMinimumBasicScenario-server-212758906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-212758906',id=44,image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqz4YzavoU5vZ+Y+rciTjuVOWbnudtf9ADqs59JcpzXge9fKEI/9MeSiATWcnoxfaQCFqmXDNdhKl/Jt5bTp2Xa1Sojz6dbZqHUtyO+El9Vs2M0GFYDExX1F2FrSAhkdQ==',key_name='tempest-TestMinimumBasicScenario-200463085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-vl3u51dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:57Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=399a6b48-bf68-4ae7-83e9-41e6014e8bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'pci_devices' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:09:58 user nova-compute[75216]:   <uuid>399a6b48-bf68-4ae7-83e9-41e6014e8bfb</uuid>
Nov 02 05:09:58 user nova-compute[75216]:   <name>instance-0000002c</name>
Nov 02 05:09:58 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:09:58 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:09:58 user nova-compute[75216]:   <metadata>
Nov 02 05:09:58 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:09:58 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:09:58 user nova-compute[75216]:       <nova:name>tempest-TestMinimumBasicScenario-server-212758906</nova:name>
Nov 02 05:09:58 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:09:58</nova:creationTime>
Nov 02 05:09:58 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:09:58 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:09:58 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:09:58 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:09:58 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:09:58 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:09:58 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:09:58 user nova-compute[75216]:       <nova:owner>
Nov 02 05:09:58 user nova-compute[75216]:         <nova:user uuid="8a60b807f9454e49917d372178cc196f">tempest-TestMinimumBasicScenario-1935471528-project-member</nova:user>
Nov 02 05:09:58 user nova-compute[75216]:         <nova:project uuid="e0bbd2a0fea340eda045059153a3ed9f">tempest-TestMinimumBasicScenario-1935471528</nova:project>
Nov 02 05:09:58 user nova-compute[75216]:       </nova:owner>
Nov 02 05:09:58 user nova-compute[75216]:       <nova:root type="image" uuid="416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb"/>
Nov 02 05:09:58 user nova-compute[75216]:       <nova:ports>
Nov 02 05:09:58 user nova-compute[75216]:         <nova:port uuid="854fad23-cb80-4a15-8cef-194613530198">
Nov 02 05:09:58 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 05:09:58 user nova-compute[75216]:         </nova:port>
Nov 02 05:09:58 user nova-compute[75216]:       </nova:ports>
Nov 02 05:09:58 user nova-compute[75216]:     </nova:instance>
Nov 02 05:09:58 user nova-compute[75216]:   </metadata>
Nov 02 05:09:58 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:09:58 user nova-compute[75216]:     <system>
Nov 02 05:09:58 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:09:58 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:09:58 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:09:58 user nova-compute[75216]:       <entry name="serial">399a6b48-bf68-4ae7-83e9-41e6014e8bfb</entry>
Nov 02 05:09:58 user nova-compute[75216]:       <entry name="uuid">399a6b48-bf68-4ae7-83e9-41e6014e8bfb</entry>
Nov 02 05:09:58 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:09:58 user nova-compute[75216]:     </system>
Nov 02 05:09:58 user nova-compute[75216]:   </sysinfo>
Nov 02 05:09:58 user nova-compute[75216]:   <os>
Nov 02 05:09:58 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:09:58 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:09:58 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:09:58 user nova-compute[75216]:   </os>
Nov 02 05:09:58 user nova-compute[75216]:   <features>
Nov 02 05:09:58 user nova-compute[75216]:     <acpi/>
Nov 02 05:09:58 user nova-compute[75216]:     <apic/>
Nov 02 05:09:58 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:09:58 user nova-compute[75216]:   </features>
Nov 02 05:09:58 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:09:58 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:09:58 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:09:58 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:09:58 user nova-compute[75216]:   </clock>
Nov 02 05:09:58 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:09:58 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:09:58 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:09:58 user nova-compute[75216]:   </cpu>
Nov 02 05:09:58 user nova-compute[75216]:   <devices>
Nov 02 05:09:58 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:09:58 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:09:58 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk"/>
Nov 02 05:09:58 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:09:58 user nova-compute[75216]:     </disk>
Nov 02 05:09:58 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:09:58 user nova-compute[75216]:       <mac address="fa:16:3e:1f:18:40"/>
Nov 02 05:09:58 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:58 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:09:58 user nova-compute[75216]:       <target dev="tap854fad23-cb"/>
Nov 02 05:09:58 user nova-compute[75216]:     </interface>
Nov 02 05:09:58 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:09:58 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/console.log" append="off"/>
Nov 02 05:09:58 user nova-compute[75216]:     </serial>
Nov 02 05:09:58 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:09:58 user nova-compute[75216]:     <video>
Nov 02 05:09:58 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:58 user nova-compute[75216]:     </video>
Nov 02 05:09:58 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:09:58 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:09:58 user nova-compute[75216]:     </rng>
Nov 02 05:09:58 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:09:58 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:09:58 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:09:58 user nova-compute[75216]:     </memballoon>
Nov 02 05:09:58 user nova-compute[75216]:   </devices>
Nov 02 05:09:58 user nova-compute[75216]: </domain>
Nov 02 05:09:58 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-212758906',display_name='tempest-TestMinimumBasicScenario-server-212758906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-212758906',id=44,image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqz4YzavoU5vZ+Y+rciTjuVOWbnudtf9ADqs59JcpzXge9fKEI/9MeSiATWcnoxfaQCFqmXDNdhKl/Jt5bTp2Xa1Sojz6dbZqHUtyO+El9Vs2M0GFYDExX1F2FrSAhkdQ==',key_name='tempest-TestMinimumBasicScenario-200463085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-vl3u51dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:57Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=399a6b48-bf68-4ae7-83e9-41e6014e8bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG os_vif [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c20f3f83-889e-56a6-8cf5-e5efd5612b74', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap854fad23-cb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap854fad23-cb, col_values=(('qos', UUID('0923c4bb-0e93-4769-8b0c-336f3f2061d9')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap854fad23-cb, col_values=(('external_ids', {'iface-id': '854fad23-cb80-4a15-8cef-194613530198', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:18:40', 'vm-uuid': '399a6b48-bf68-4ae7-83e9-41e6014e8bfb'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: INFO os_vif [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb')
Nov 02 05:09:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26632663738323137', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632663738323137', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No VIF found with MAC fa:16:3e:1f:18:40, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-667020298',display_name='tempest-TestVolumeBootPattern-server-667020298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-667020298',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-hto2y3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:35Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=72d2b252-e597-49dd-ad25-ac0790a31613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c5:12,bridge_name='br-int',has_traffic_filtering=True,id=6837405c-3968-4c95-80fc-0c1e063e2e8f,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837405c-39') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'pci_devices' on Instance uuid 72d2b252-e597-49dd-ad25-ac0790a31613 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:09:59 user nova-compute[75216]:   <uuid>72d2b252-e597-49dd-ad25-ac0790a31613</uuid>
Nov 02 05:09:59 user nova-compute[75216]:   <name>instance-0000002a</name>
Nov 02 05:09:59 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:09:59 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:09:59 user nova-compute[75216]:   <metadata>
Nov 02 05:09:59 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:09:59 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:09:59 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-667020298</nova:name>
Nov 02 05:09:59 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:09:57</nova:creationTime>
Nov 02 05:09:59 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:09:59 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:09:59 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:09:59 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:09:59 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:09:59 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:09:59 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:09:59 user nova-compute[75216]:       <nova:owner>
Nov 02 05:09:59 user nova-compute[75216]:         <nova:user uuid="94f0b01ce0c744bdbb937e0a477dcf07">tempest-TestVolumeBootPattern-773799094-project-member</nova:user>
Nov 02 05:09:59 user nova-compute[75216]:         <nova:project uuid="9eeaefe9a0e4468d9bbb99ba3aca7c64">tempest-TestVolumeBootPattern-773799094</nova:project>
Nov 02 05:09:59 user nova-compute[75216]:       </nova:owner>
Nov 02 05:09:59 user nova-compute[75216]:       <nova:ports>
Nov 02 05:09:59 user nova-compute[75216]:         <nova:port uuid="6837405c-3968-4c95-80fc-0c1e063e2e8f">
Nov 02 05:09:59 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 05:09:59 user nova-compute[75216]:         </nova:port>
Nov 02 05:09:59 user nova-compute[75216]:       </nova:ports>
Nov 02 05:09:59 user nova-compute[75216]:     </nova:instance>
Nov 02 05:09:59 user nova-compute[75216]:   </metadata>
Nov 02 05:09:59 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:09:59 user nova-compute[75216]:     <system>
Nov 02 05:09:59 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:09:59 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:09:59 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:09:59 user nova-compute[75216]:       <entry name="serial">72d2b252-e597-49dd-ad25-ac0790a31613</entry>
Nov 02 05:09:59 user nova-compute[75216]:       <entry name="uuid">72d2b252-e597-49dd-ad25-ac0790a31613</entry>
Nov 02 05:09:59 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:09:59 user nova-compute[75216]:     </system>
Nov 02 05:09:59 user nova-compute[75216]:   </sysinfo>
Nov 02 05:09:59 user nova-compute[75216]:   <os>
Nov 02 05:09:59 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:09:59 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:09:59 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:09:59 user nova-compute[75216]:   </os>
Nov 02 05:09:59 user nova-compute[75216]:   <features>
Nov 02 05:09:59 user nova-compute[75216]:     <acpi/>
Nov 02 05:09:59 user nova-compute[75216]:     <apic/>
Nov 02 05:09:59 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:09:59 user nova-compute[75216]:   </features>
Nov 02 05:09:59 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:09:59 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:09:59 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:09:59 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:09:59 user nova-compute[75216]:   </clock>
Nov 02 05:09:59 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:09:59 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:09:59 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:09:59 user nova-compute[75216]:   </cpu>
Nov 02 05:09:59 user nova-compute[75216]:   <devices>
Nov 02 05:09:59 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:09:59 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:09:59 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 02 05:09:59 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:09:59 user nova-compute[75216]:       <serial>ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a</serial>
Nov 02 05:09:59 user nova-compute[75216]:     </disk>
Nov 02 05:09:59 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:09:59 user nova-compute[75216]:       <mac address="fa:16:3e:ca:c5:12"/>
Nov 02 05:09:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:59 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:09:59 user nova-compute[75216]:       <target dev="tap6837405c-39"/>
Nov 02 05:09:59 user nova-compute[75216]:     </interface>
Nov 02 05:09:59 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:09:59 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/72d2b252-e597-49dd-ad25-ac0790a31613/console.log" append="off"/>
Nov 02 05:09:59 user nova-compute[75216]:     </serial>
Nov 02 05:09:59 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:09:59 user nova-compute[75216]:     <video>
Nov 02 05:09:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:09:59 user nova-compute[75216]:     </video>
Nov 02 05:09:59 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:09:59 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:09:59 user nova-compute[75216]:     </rng>
Nov 02 05:09:59 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:09:59 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:09:59 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:09:59 user nova-compute[75216]:     </memballoon>
Nov 02 05:09:59 user nova-compute[75216]:   </devices>
Nov 02 05:09:59 user nova-compute[75216]: </domain>
Nov 02 05:09:59 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-667020298',display_name='tempest-TestVolumeBootPattern-server-667020298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-667020298',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-hto2y3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:09:35Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=72d2b252-e597-49dd-ad25-ac0790a31613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c5:12,bridge_name='br-int',has_traffic_filtering=True,id=6837405c-3968-4c95-80fc-0c1e063e2e8f,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837405c-39') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG os_vif [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c5:12,bridge_name='br-int',has_traffic_filtering=True,id=6837405c-3968-4c95-80fc-0c1e063e2e8f,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837405c-39') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '321059d4-5907-5414-a86d-0ff751657a41', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6837405c-39, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6837405c-39, col_values=(('qos', UUID('52d03844-62c3-4239-88d8-89916535ed8c')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6837405c-39, col_values=(('external_ids', {'iface-id': '6837405c-3968-4c95-80fc-0c1e063e2e8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:c5:12', 'vm-uuid': '72d2b252-e597-49dd-ad25-ac0790a31613'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:09:59 user nova-compute[75216]: INFO os_vif [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c5:12,bridge_name='br-int',has_traffic_filtering=True,id=6837405c-3968-4c95-80fc-0c1e063e2e8f,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837405c-39')
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No VIF found with MAC fa:16:3e:ca:c5:12, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated VIF entry in instance network info cache for port 854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:09:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-10037de7-2a42-4eb6-a2c4-e194d84c6a23 req-d47a7fea-d6a0-4cfa-aa2b-98c4465a898b service nova] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-e2d99992-5e51-4ed2-95dd-d2d50f724c13 req-c6635a81-f599-45b1-9f61-a43cbc3048ee service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e2d99992-5e51-4ed2-95dd-d2d50f724c13 req-c6635a81-f599-45b1-9f61-a43cbc3048ee service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e2d99992-5e51-4ed2-95dd-d2d50f724c13 req-c6635a81-f599-45b1-9f61-a43cbc3048ee service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e2d99992-5e51-4ed2-95dd-d2d50f724c13 req-c6635a81-f599-45b1-9f61-a43cbc3048ee service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-e2d99992-5e51-4ed2-95dd-d2d50f724c13 req-c6635a81-f599-45b1-9f61-a43cbc3048ee service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:10:01 user nova-compute[75216]: WARNING nova.compute.manager [req-e2d99992-5e51-4ed2-95dd-d2d50f724c13 req-c6635a81-f599-45b1-9f61-a43cbc3048ee service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received unexpected event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 for instance with vm_state building and task_state spawning.
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:10:03 user nova-compute[75216]: WARNING nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received unexpected event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 for instance with vm_state building and task_state spawning.
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] No waiting events found dispatching network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:10:03 user nova-compute[75216]: WARNING nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received unexpected event network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f for instance with vm_state building and task_state spawning.
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] No waiting events found dispatching network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:10:03 user nova-compute[75216]: WARNING nova.compute.manager [req-2b393aad-840c-4d31-9e1d-d0f878636825 req-cd55d5fe-740d-4573-b03f-ffce8108d48f service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received unexpected event network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f for instance with vm_state building and task_state spawning.
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:10:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance spawned successfully.
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:10:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Instance spawned successfully.
Nov 02 05:10:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:10:04 user nova-compute[75216]: INFO nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Took 7.49 seconds to spawn the instance on the hypervisor.
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:10:04 user nova-compute[75216]: INFO nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:04 user nova-compute[75216]: INFO nova.compute.manager [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Took 29.99 seconds to build instance.
Nov 02 05:10:04 user nova-compute[75216]: INFO nova.compute.manager [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Took 8.40 seconds to build instance.
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-860e65c6-cb0a-45b6-8c61-7b3ccc68578c tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "72d2b252-e597-49dd-ad25-ac0790a31613" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.202s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4fd8f6f8-820c-49bd-abd5-145b42a8a6b7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.494s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid e99b36cc-571e-46d6-9a30-7aa3a0801ffd {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 72d2b252-e597-49dd-ad25-ac0790a31613 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid a69aa2eb-70c9-4c93-8cba-63728feecab2 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "72d2b252-e597-49dd-ad25-ac0790a31613" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "72d2b252-e597-49dd-ad25-ac0790a31613" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e is timed out.
Nov 02 05:10:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Successfully detached device vdc from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the live domain config.
Nov 02 05:10:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRbMerzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:10:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef497cc-1712-4a4c-97f5-0a4fa1fa8589]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:10:08 user nova-compute[75216]: No targets found.
Nov 02 05:10:08 user nova-compute[75216]: iSNS:
Nov 02 05:10:08 user nova-compute[75216]: No targets found.
Nov 02 05:10:08 user nova-compute[75216]: STATIC:
Nov 02 05:10:08 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4
Nov 02 05:10:08 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:10:08 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:10:08 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a
Nov 02 05:10:08 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:10:08 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:10:08 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:10:08 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:10:08 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:10:08 user nova-compute[75216]: FIRMWARE:
Nov 02 05:10:08 user nova-compute[75216]: No targets found.
Nov 02 05:10:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:10:08 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:10:08 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbb131a-9ed8-4f47-b118-53347f289187]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e344741c-f779-4fb0-bb0b-e4a9f1fd31fe]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:10:08 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:10:08 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:10:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:10:08 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a (non-flash)
Nov 02 05:10:08 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:10:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec3af760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fddae6e-d467-4c9f-a63a-a8fc6663e89c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f22e68f-e03b-4b0e-94eb-d83a042921b3]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5582e84-20e3-4a66-84b9-87d01ed03052]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01c2a8c-6918-4834-9d92-bb47c535aefd]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d15431-995c-400b-ae4c-f7e32380e4cd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c5bdb3-330d-4638-bc5c-33979bfec55a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260]
Nov 02 05:10:08 user nova-compute[75216]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a, portal: 172.16.0.220,3260] successful.
Nov 02 05:10:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:861839bb-fc15-4bb8-9938-f9410c86c30a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8568b7d-2d26-4169-b9f5-6ae47f40ec74]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] <== disconnect_volume: return (305ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:10:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:10:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'flavor' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:10:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b2c72082-e9ea-42f3-93e5-783060ca598e tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.924s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.087s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:26 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:10:27 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8016MB free_disk=24.907638549804688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0ed080f2-eb48-45ce-b67b-4949672c93d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 72d2b252-e597-49dd-ad25-ac0790a31613 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a69aa2eb-70c9-4c93-8cba-63728feecab2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:27 user nova-compute[75216]: INFO nova.compute.manager [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Terminating instance
Nov 02 05:10:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:10:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-cf347490-bad3-4260-b9c0-cf0033705b85 req-c4fc2fc1-24bf-444c-bebc-4212bb16c8c2 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-vif-unplugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cf347490-bad3-4260-b9c0-cf0033705b85 req-c4fc2fc1-24bf-444c-bebc-4212bb16c8c2 service nova] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cf347490-bad3-4260-b9c0-cf0033705b85 req-c4fc2fc1-24bf-444c-bebc-4212bb16c8c2 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cf347490-bad3-4260-b9c0-cf0033705b85 req-c4fc2fc1-24bf-444c-bebc-4212bb16c8c2 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-cf347490-bad3-4260-b9c0-cf0033705b85 req-c4fc2fc1-24bf-444c-bebc-4212bb16c8c2 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] No waiting events found dispatching network-vif-unplugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-cf347490-bad3-4260-b9c0-cf0033705b85 req-c4fc2fc1-24bf-444c-bebc-4212bb16c8c2 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-vif-unplugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Instance destroyed successfully.
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lazy-loading 'resources' on Instance uuid e99b36cc-571e-46d6-9a30-7aa3a0801ffd {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T04:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-505671485',display_name='tempest-ServerActionsTestOtherA-server-505671485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-505671485',id=17,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvrTR1i1n0XZpNNi3LcTEfJR9oKJUJQjP7SHFPVx6jUhjkD1uEaXWo5ebeCiPSQ8igCmZkjQuVtk9ZoxsbtvVbzsPDjtqSTqODvJUrfa5M6YuHmeJ5TSFxgatKgNtIHCA==',key_name='tempest-keypair-1658981970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T04:50:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='597c9027651a4044a6514c1ab0ec9ad8',ramdisk_id='',reservation_id='r-oojswmeo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-511412938',owner_user_name='tempest-ServerActionsTestOtherA-511412938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T04:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3af262ef734b2d8a1b3208e5749fb3',uuid=e99b36cc-571e-46d6-9a30-7aa3a0801ffd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converting VIF {"id": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "address": "fa:16:3e:f2:0b:df", "network": {"id": "2fd243a4-6812-4b73-a2cc-cecc53ca76aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1956484114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "597c9027651a4044a6514c1ab0ec9ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa57ac7-5b", "ovs_interfaceid": "0fa57ac7-5baf-476a-b5be-44a9e834d05f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=0fa57ac7-5baf-476a-b5be-44a9e834d05f,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa57ac7-5b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG os_vif [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=0fa57ac7-5baf-476a-b5be-44a9e834d05f,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa57ac7-5b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fa57ac7-5b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5cc7fa8-d5a0-4b2e-aee0-fbdb2369d05d) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:28 user nova-compute[75216]: INFO os_vif [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=0fa57ac7-5baf-476a-b5be-44a9e834d05f,network=Network(2fd243a4-6812-4b73-a2cc-cecc53ca76aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa57ac7-5b')
Nov 02 05:10:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Deleting instance files /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd_del
Nov 02 05:10:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Deletion of /opt/stack/data/nova/instances/e99b36cc-571e-46d6-9a30-7aa3a0801ffd_del complete
Nov 02 05:10:28 user nova-compute[75216]: INFO nova.compute.manager [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 05:10:28 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:10:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:10:29 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Took 0.48 seconds to deallocate network for instance.
Nov 02 05:10:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:10:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:29 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Deleted allocations for instance e99b36cc-571e-46d6-9a30-7aa3a0801ffd
Nov 02 05:10:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f49ad5f8-5baa-4490-860f-6a4959a6521d tempest-ServerActionsTestOtherA-511412938 tempest-ServerActionsTestOtherA-511412938-project-member] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-bc6bbc5c-cd91-4984-8140-a619bd2f0273 req-d767b999-434d-4c45-aea7-3c883d367eb6 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bc6bbc5c-cd91-4984-8140-a619bd2f0273 req-d767b999-434d-4c45-aea7-3c883d367eb6 service nova] Acquiring lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bc6bbc5c-cd91-4984-8140-a619bd2f0273 req-d767b999-434d-4c45-aea7-3c883d367eb6 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bc6bbc5c-cd91-4984-8140-a619bd2f0273 req-d767b999-434d-4c45-aea7-3c883d367eb6 service nova] Lock "e99b36cc-571e-46d6-9a30-7aa3a0801ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:10:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-bc6bbc5c-cd91-4984-8140-a619bd2f0273 req-d767b999-434d-4c45-aea7-3c883d367eb6 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] No waiting events found dispatching network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:10:30 user nova-compute[75216]: WARNING nova.compute.manager [req-bc6bbc5c-cd91-4984-8140-a619bd2f0273 req-d767b999-434d-4c45-aea7-3c883d367eb6 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received unexpected event network-vif-plugged-0fa57ac7-5baf-476a-b5be-44a9e834d05f for instance with vm_state deleted and task_state None.
Nov 02 05:10:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-bc6bbc5c-cd91-4984-8140-a619bd2f0273 req-d767b999-434d-4c45-aea7-3c883d367eb6 service nova] [instance: e99b36cc-571e-46d6-9a30-7aa3a0801ffd] Received event network-vif-deleted-0fa57ac7-5baf-476a-b5be-44a9e834d05f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:10:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:10:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:10:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:10:38 user nova-compute[75216]: INFO nova.compute.manager [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Detaching volume 14777fae-70d4-4e4b-8935-443fbc1766e4
Nov 02 05:10:38 user nova-compute[75216]: INFO nova.virt.block_device [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Attempting to driver detach volume 14777fae-70d4-4e4b-8935-443fbc1766e4 from mountpoint /dev/vdb
Nov 02 05:10:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Attempting to detach device vdb from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:10:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:10:38 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:10:38 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 05:10:38 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:10:38 user nova-compute[75216]:   <serial>14777fae-70d4-4e4b-8935-443fbc1766e4</serial>
Nov 02 05:10:38 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:10:38 user nova-compute[75216]: </disk>
Nov 02 05:10:38 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:10:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Successfully detached device vdb from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the persistent domain config.
Nov 02 05:10:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:10:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:10:38 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:10:38 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 05:10:38 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:10:38 user nova-compute[75216]:   <serial>14777fae-70d4-4e4b-8935-443fbc1766e4</serial>
Nov 02 05:10:38 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:10:38 user nova-compute[75216]: </disk>
Nov 02 05:10:38 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:10:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:10:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:10:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:10:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:10:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:10:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-changed-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:10:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing instance network info cache due to event network-changed-469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:10:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] Acquiring lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:10:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] Acquired lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:10:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:10:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updated VIF entry in instance network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:10:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:10:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a519ee36-e76b-44f0-be70-e919b6ef2fbc req-5f426aff-31d7-4b21-9c9d-377967e61736 service nova] Releasing lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:10:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:10:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e is timed out.
Nov 02 05:10:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Successfully detached device vdb from instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e from the live domain config.
Nov 02 05:10:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izkZhgxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:10:58 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcb52a2-9bb1-47c1-a5fa-761423868409]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:10:58 user nova-compute[75216]: No targets found.
Nov 02 05:10:58 user nova-compute[75216]: iSNS:
Nov 02 05:10:58 user nova-compute[75216]: No targets found.
Nov 02 05:10:58 user nova-compute[75216]: STATIC:
Nov 02 05:10:58 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4
Nov 02 05:10:58 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:10:58 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:10:58 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:10:58 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:10:58 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:10:58 user nova-compute[75216]: FIRMWARE:
Nov 02 05:10:58 user nova-compute[75216]: No targets found.
Nov 02 05:10:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:10:58 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:10:58 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7fbae-c835-4168-beaf-c59a4d6aedd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c64e86b-9e61-414a-8630-2181cb60bee8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:10:58 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:10:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 (non-flash)
Nov 02 05:10:58 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:10:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec3404c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eff9973-635e-4d17-bd66-88f08bfdd89d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9354bed-9a16-4918-8071-10af91d0d0c8]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[46739a00-dea5-4abd-a508-945e3458e507]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:10:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[657ede96-7231-42ee-a68f-386d1b5fb7c8]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a33ab8b-a23e-401b-82b6-6c04cfc540e8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aab3ca1-b9a2-40b1-9dee-f94b43c92625]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260]
Nov 02 05:10:59 user nova-compute[75216]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4, portal: 172.16.0.220,3260] successful.
Nov 02 05:10:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14777fae-70d4-4e4b-8935-443fbc1766e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8a907e-a7c4-4e10-b6e6-496581cab0e7]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] <== disconnect_volume: return (307ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:10:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:11:00 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'flavor' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fdfd9dcf-0fcf-42be-811c-2cb73ecc96c6 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.789s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:03 user nova-compute[75216]: INFO nova.compute.manager [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Shelving
Nov 02 05:11:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-347db979-f39f-4c00-a0d1-c9c38b2b4ed2 req-c78839a8-90b4-409a-87c1-d18b28c78b9c service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-unplugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-347db979-f39f-4c00-a0d1-c9c38b2b4ed2 req-c78839a8-90b4-409a-87c1-d18b28c78b9c service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-347db979-f39f-4c00-a0d1-c9c38b2b4ed2 req-c78839a8-90b4-409a-87c1-d18b28c78b9c service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-347db979-f39f-4c00-a0d1-c9c38b2b4ed2 req-c78839a8-90b4-409a-87c1-d18b28c78b9c service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-347db979-f39f-4c00-a0d1-c9c38b2b4ed2 req-c78839a8-90b4-409a-87c1-d18b28c78b9c service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-unplugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:03 user nova-compute[75216]: WARNING nova.compute.manager [req-347db979-f39f-4c00-a0d1-c9c38b2b4ed2 req-c78839a8-90b4-409a-87c1-d18b28c78b9c service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received unexpected event network-vif-unplugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with vm_state active and task_state shelving.
Nov 02 05:11:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance destroyed successfully.
Nov 02 05:11:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Beginning cold snapshot process
Nov 02 05:11:04 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 05:11:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk /opt/stack/data/nova/instances/snapshots/tmpl8qlppnw/a67240009b91457f9035fc60a3b5b598 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk /opt/stack/data/nova/instances/snapshots/tmpl8qlppnw/a67240009b91457f9035fc60a3b5b598" returned: 0 in 0.965s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Snapshot extracted, beginning image upload
Nov 02 05:11:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-b0e3196a-85cd-4381-9fc2-b21e43497622 req-1bcb0875-2728-464f-90bb-217f8af0d0a6 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0e3196a-85cd-4381-9fc2-b21e43497622 req-1bcb0875-2728-464f-90bb-217f8af0d0a6 service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0e3196a-85cd-4381-9fc2-b21e43497622 req-1bcb0875-2728-464f-90bb-217f8af0d0a6 service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0e3196a-85cd-4381-9fc2-b21e43497622 req-1bcb0875-2728-464f-90bb-217f8af0d0a6 service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-b0e3196a-85cd-4381-9fc2-b21e43497622 req-1bcb0875-2728-464f-90bb-217f8af0d0a6 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:05 user nova-compute[75216]: WARNING nova.compute.manager [req-b0e3196a-85cd-4381-9fc2-b21e43497622 req-1bcb0875-2728-464f-90bb-217f8af0d0a6 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received unexpected event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 05:11:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Snapshot image upload complete
Nov 02 05:11:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:11:08 user nova-compute[75216]: INFO nova.compute.manager [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Shelve offloading
Nov 02 05:11:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance destroyed successfully.
Nov 02 05:11:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:11:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:11:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquired lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:11:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:11:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Releasing lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:11:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance destroyed successfully.
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'resources' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-572366251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-572366251',id=41,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgGW7yb4icMqF0naGl12n9jNQKOz1BnQrpbCXIwCkukV0UuDJ05ZpTXSEtqOmUmdxm/buWQd/ojVUrl/WLxM/YN1W/OBdYXk/49Roibr2rM2z85bm3DtA+aueFHdpTXYQ==',key_name='tempest-keypair-2031242040',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-b3w5h0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member',shelved_at='2023-11-02T05:11:08.003510',shelved_host='user',shelved_image_id='c45b25a7-30d8-48fc-aa85-7acee052c018'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=0ed080f2-eb48-45ce-b67b-4949672c93d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG os_vif [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469ad201-02, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-changed-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing instance network info cache due to event network-changed-469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] Acquiring lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] Acquired lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b5aaa8a-c6ef-44d1-9b05-813a976bcd00) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:09 user nova-compute[75216]: INFO os_vif [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02')
Nov 02 05:11:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Deleting instance files /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4_del
Nov 02 05:11:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Deletion of /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4_del complete
Nov 02 05:11:09 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Deleted allocations for instance 0ed080f2-eb48-45ce-b67b-4949672c93d4
Nov 02 05:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.objects.base [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<0ed080f2-eb48-45ce-b67b-4949672c93d4> lazy-loaded attributes: resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updated VIF entry in instance network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap469ad201-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37e5dd25-ed00-48cc-b860-d0b5c721969d tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.966s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a1e1d3e-7fec-4361-9f03-cf377609c15d req-995fafa3-4918-485e-a993-3929459c4764 service nova] Releasing lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:11:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:26 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:11:26 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8354MB free_disk=24.911521911621094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-changed-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Refreshing instance network info cache due to event network-changed-6837405c-3968-4c95-80fc-0c1e063e2e8f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] Acquiring lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] Acquired lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Refreshing network info cache for port 6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 72d2b252-e597-49dd-ad25-ac0790a31613 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance a69aa2eb-70c9-4c93-8cba-63728feecab2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "72d2b252-e597-49dd-ad25-ac0790a31613" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:26 user nova-compute[75216]: INFO nova.compute.manager [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Terminating instance
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:26 user nova-compute[75216]: INFO nova.compute.manager [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Terminating instance
Nov 02 05:11:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ebcbbbd-f654-44db-97e9-b97066254e26 req-5a070df9-bb01-4819-b12c-4af9658736ea service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-vif-unplugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ebcbbbd-f654-44db-97e9-b97066254e26 req-5a070df9-bb01-4819-b12c-4af9658736ea service nova] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ebcbbbd-f654-44db-97e9-b97066254e26 req-5a070df9-bb01-4819-b12c-4af9658736ea service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ebcbbbd-f654-44db-97e9-b97066254e26 req-5a070df9-bb01-4819-b12c-4af9658736ea service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ebcbbbd-f654-44db-97e9-b97066254e26 req-5a070df9-bb01-4819-b12c-4af9658736ea service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] No waiting events found dispatching network-vif-unplugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ebcbbbd-f654-44db-97e9-b97066254e26 req-5a070df9-bb01-4819-b12c-4af9658736ea service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-vif-unplugged-6837405c-3968-4c95-80fc-0c1e063e2e8f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.network.neutron [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Updated VIF entry in instance network info cache for port 6837405c-3968-4c95-80fc-0c1e063e2e8f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.network.neutron [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Updating instance_info_cache with network_info: [{"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4da84771-24ae-44e2-b81b-fcc2888fe519 req-dbc7f52a-c046-4e9e-a140-f8cd77cfc240 service nova] Releasing lock "refresh_cache-72d2b252-e597-49dd-ad25-ac0790a31613" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-fd52616a-0572-4dfe-b49c-cbbd7334dddb req-b9a7e37e-5f86-4a01-b53f-b8c34e17dc14 service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received event network-vif-unplugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fd52616a-0572-4dfe-b49c-cbbd7334dddb req-b9a7e37e-5f86-4a01-b53f-b8c34e17dc14 service nova] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fd52616a-0572-4dfe-b49c-cbbd7334dddb req-b9a7e37e-5f86-4a01-b53f-b8c34e17dc14 service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fd52616a-0572-4dfe-b49c-cbbd7334dddb req-b9a7e37e-5f86-4a01-b53f-b8c34e17dc14 service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-fd52616a-0572-4dfe-b49c-cbbd7334dddb req-b9a7e37e-5f86-4a01-b53f-b8c34e17dc14 service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] No waiting events found dispatching network-vif-unplugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-fd52616a-0572-4dfe-b49c-cbbd7334dddb req-b9a7e37e-5f86-4a01-b53f-b8c34e17dc14 service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received event network-vif-unplugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:11:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Instance destroyed successfully.
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lazy-loading 'resources' on Instance uuid a69aa2eb-70c9-4c93-8cba-63728feecab2 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Instance destroyed successfully.
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'resources' on Instance uuid 72d2b252-e597-49dd-ad25-ac0790a31613 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-742495288',display_name='tempest-VolumesActionsTest-instance-742495288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-742495288',id=43,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513adbd7b8f541febe9927ba78eee782',ramdisk_id='',reservation_id='r-y2pbdrxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-796192132',owner_user_name='tempest-VolumesActionsTest-796192132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:09:43Z,user_data=None,user_id='c0dd6755004247af9058fe05adcd950d',uuid=a69aa2eb-70c9-4c93-8cba-63728feecab2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converting VIF {"id": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "address": "fa:16:3e:30:3d:68", "network": {"id": "b0c9d6db-cdb7-4489-9e1f-e5b218b05847", "bridge": "br-int", "label": "tempest-VolumesActionsTest-914530987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513adbd7b8f541febe9927ba78eee782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b313b59-b1", "ovs_interfaceid": "3b313b59-b166-4228-bd2e-a2a96443ebe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:68,bridge_name='br-int',has_traffic_filtering=True,id=3b313b59-b166-4228-bd2e-a2a96443ebe9,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b313b59-b1') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_vif [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:68,bridge_name='br-int',has_traffic_filtering=True,id=3b313b59-b166-4228-bd2e-a2a96443ebe9,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b313b59-b1') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b313b59-b1, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-667020298',display_name='tempest-TestVolumeBootPattern-server-667020298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-667020298',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:10:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-hto2y3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:10:04Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=72d2b252-e597-49dd-ad25-ac0790a31613,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "address": "fa:16:3e:ca:c5:12", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6837405c-39", "ovs_interfaceid": "6837405c-3968-4c95-80fc-0c1e063e2e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c5:12,bridge_name='br-int',has_traffic_filtering=True,id=6837405c-3968-4c95-80fc-0c1e063e2e8f,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837405c-39') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_vif [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c5:12,bridge_name='br-int',has_traffic_filtering=True,id=6837405c-3968-4c95-80fc-0c1e063e2e8f,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837405c-39') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6837405c-39, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dfb17eb-81e9-4ba4-a1a5-ef3f8082f6c0) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52d03844-62c3-4239-88d8-89916535ed8c) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:27 user nova-compute[75216]: INFO os_vif [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:68,bridge_name='br-int',has_traffic_filtering=True,id=3b313b59-b166-4228-bd2e-a2a96443ebe9,network=Network(b0c9d6db-cdb7-4489-9e1f-e5b218b05847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b313b59-b1')
Nov 02 05:11:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Deleting instance files /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2_del
Nov 02 05:11:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Deletion of /opt/stack/data/nova/instances/a69aa2eb-70c9-4c93-8cba-63728feecab2_del complete
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:27 user nova-compute[75216]: INFO os_vif [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c5:12,bridge_name='br-int',has_traffic_filtering=True,id=6837405c-3968-4c95-80fc-0c1e063e2e8f,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6837405c-39')
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:11:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f90ff-ce67-4513-b9e3-68c1777e6009]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:11:27 user nova-compute[75216]: No targets found.
Nov 02 05:11:27 user nova-compute[75216]: iSNS:
Nov 02 05:11:27 user nova-compute[75216]: No targets found.
Nov 02 05:11:27 user nova-compute[75216]: STATIC:
Nov 02 05:11:27 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:11:27 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:11:27 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:11:27 user nova-compute[75216]: FIRMWARE:
Nov 02 05:11:27 user nova-compute[75216]: No targets found.
Nov 02 05:11:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:11:27 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:11:27 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8615d90-9f5d-440a-9d7c-63ed4e9a4e52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:27 user nova-compute[75216]: INFO nova.compute.manager [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ccd599-0366-4c7b-844c-48ff1bf90182]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:11:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:11:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460d671090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e6b94f-2746-4087-8f82-2f6c3dc46acd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d3deb-e86c-4c3b-87f4-da92db17991d]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[864443a2-0cf5-4401-bd86-74771745a6e9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c80f697-1b7e-4e01-893f-5ea4158f3206]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_de92fdd8', '/dev/disk/by-id/scsi-1SCST_BIOde92fdd8-f2f78217ddc31c40', '/dev/disk/by-id/scsi-26632663738323137') {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c05b57-821b-4a24-a601-d456945b0173]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb07c18c-32ca-4e2d-8e60-22d4140f0f01]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f5ae10-7dde-4dde-b5a8-96187f47777b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]
Nov 02 05:11:28 user nova-compute[75216]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.
Nov 02 05:11:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba1f449-4cab-4c80-bb5a-58cb4219fac6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== disconnect_volume: return (324ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:11:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Deleting instance files /opt/stack/data/nova/instances/72d2b252-e597-49dd-ad25-ac0790a31613_del
Nov 02 05:11:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Deletion of /opt/stack/data/nova/instances/72d2b252-e597-49dd-ad25-ac0790a31613_del complete
Nov 02 05:11:28 user nova-compute[75216]: INFO nova.compute.manager [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:28 user nova-compute[75216]: INFO nova.compute.manager [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Terminating instance
Nov 02 05:11:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:28 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Took 0.80 seconds to deallocate network for instance.
Nov 02 05:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:29 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Deleted allocations for instance a69aa2eb-70c9-4c93-8cba-63728feecab2
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b2744bc7-b712-4086-b2bd-e6fa504aa274 req-08a7b503-9e67-4c2e-92e3-878c1fd2590c service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b2744bc7-b712-4086-b2bd-e6fa504aa274 req-08a7b503-9e67-4c2e-92e3-878c1fd2590c service nova] Acquiring lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b2744bc7-b712-4086-b2bd-e6fa504aa274 req-08a7b503-9e67-4c2e-92e3-878c1fd2590c service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b2744bc7-b712-4086-b2bd-e6fa504aa274 req-08a7b503-9e67-4c2e-92e3-878c1fd2590c service nova] Lock "72d2b252-e597-49dd-ad25-ac0790a31613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b2744bc7-b712-4086-b2bd-e6fa504aa274 req-08a7b503-9e67-4c2e-92e3-878c1fd2590c service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] No waiting events found dispatching network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:29 user nova-compute[75216]: WARNING nova.compute.manager [req-b2744bc7-b712-4086-b2bd-e6fa504aa274 req-08a7b503-9e67-4c2e-92e3-878c1fd2590c service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received unexpected event network-vif-plugged-6837405c-3968-4c95-80fc-0c1e063e2e8f for instance with vm_state active and task_state deleting.
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f59c7b9-477a-4b2e-9dfc-971e87de6c47 tempest-VolumesActionsTest-796192132 tempest-VolumesActionsTest-796192132-project-member] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received event network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] Acquiring lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] Lock "a69aa2eb-70c9-4c93-8cba-63728feecab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] No waiting events found dispatching network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:29 user nova-compute[75216]: WARNING nova.compute.manager [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received unexpected event network-vif-plugged-3b313b59-b166-4228-bd2e-a2a96443ebe9 for instance with vm_state deleted and task_state None.
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] [instance: a69aa2eb-70c9-4c93-8cba-63728feecab2] Received event network-vif-deleted-3b313b59-b166-4228-bd2e-a2a96443ebe9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-vif-unplugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] No waiting events found dispatching network-vif-unplugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ae7200-5073-482e-8cd9-266414603eb0 req-6e9afbeb-aa58-492e-9026-d633a87a2425 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-vif-unplugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:11:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Instance destroyed successfully.
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lazy-loading 'resources' on Instance uuid 6eb5bdfc-4edd-409c-b228-f557b1aac60e {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-927850970',display_name='tempest-TestServerVolumeAttachmentScenario-server-927850970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-927850970',id=38,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK81vLlUJvQJED2ff3Wo4ZpiOVFKIpMJLKL9DspfDGT1vfoKaHtQNoSKNJ2zZ2rwx5XXksBRQ/j4mBrQoN7wrBLRKYMbhkgaaOvbgEOwum8NUYNKC9WKuj8WmnAkxgpQIA==',key_name='tempest-keypair-1341377621',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8aa7dd9f60624ed68e65b20d0f921f56',ramdisk_id='',reservation_id='r-vdis71rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-468811425',owner_user_name='tempest-TestServerVolumeAttachmentScenario-468811425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d10dc8da91e46ffa095d50b13731b53',uuid=6eb5bdfc-4edd-409c-b228-f557b1aac60e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Converting VIF {"id": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "address": "fa:16:3e:fb:f5:37", "network": {"id": "4ecda183-b41c-48c6-8d7d-59c695e35376", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1207184872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa7dd9f60624ed68e65b20d0f921f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8a785e-9f", "ovs_interfaceid": "bf8a785e-9ff6-4209-ab93-82c3c3adc396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=bf8a785e-9ff6-4209-ab93-82c3c3adc396,network=Network(4ecda183-b41c-48c6-8d7d-59c695e35376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8a785e-9f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG os_vif [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=bf8a785e-9ff6-4209-ab93-82c3c3adc396,network=Network(4ecda183-b41c-48c6-8d7d-59c695e35376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8a785e-9f') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf8a785e-9f, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29b0e6bd-0f9c-426e-ab76-d04d5a90569c) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:29 user nova-compute[75216]: INFO os_vif [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:f5:37,bridge_name='br-int',has_traffic_filtering=True,id=bf8a785e-9ff6-4209-ab93-82c3c3adc396,network=Network(4ecda183-b41c-48c6-8d7d-59c695e35376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8a785e-9f')
Nov 02 05:11:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Deleting instance files /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e_del
Nov 02 05:11:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Deletion of /opt/stack/data/nova/instances/6eb5bdfc-4edd-409c-b228-f557b1aac60e_del complete
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:29 user nova-compute[75216]: INFO nova.compute.manager [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 02 05:11:29 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:11:29 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Took 1.42 seconds to deallocate network for instance.
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:11:29 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:11:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:30 user nova-compute[75216]: INFO nova.compute.manager [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Took 0.90 seconds to detach 1 volumes for instance.
Nov 02 05:11:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:30 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:11:30 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:11:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:30 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Deleted allocations for instance 72d2b252-e597-49dd-ad25-ac0790a31613
Nov 02 05:11:30 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:30 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Took 1.22 seconds to deallocate network for instance.
Nov 02 05:11:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-35030901-77aa-4a64-9b6a-3cefc30d0e19 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "72d2b252-e597-49dd-ad25-ac0790a31613" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.248s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:31 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Deleted allocations for instance 6eb5bdfc-4edd-409c-b228-f557b1aac60e
Nov 02 05:11:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f40f2425-0a74-44a9-8281-904055990d67 tempest-TestServerVolumeAttachmentScenario-468811425 tempest-TestServerVolumeAttachmentScenario-468811425-project-member] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.663s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-be51db46-b969-4f6d-8c36-79f3a72eadf8 req-eb602e95-7333-4cb8-94fd-25c9ad661de3 service nova] [instance: 72d2b252-e597-49dd-ad25-ac0790a31613] Received event network-vif-deleted-6837405c-3968-4c95-80fc-0c1e063e2e8f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-be51db46-b969-4f6d-8c36-79f3a72eadf8 req-eb602e95-7333-4cb8-94fd-25c9ad661de3 service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-vif-deleted-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e434772-83b1-47cb-a86d-3425711d1074 req-e4ef268c-59b7-43e4-bec0-fb00099e490c service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received event network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e434772-83b1-47cb-a86d-3425711d1074 req-e4ef268c-59b7-43e4-bec0-fb00099e490c service nova] Acquiring lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e434772-83b1-47cb-a86d-3425711d1074 req-e4ef268c-59b7-43e4-bec0-fb00099e490c service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e434772-83b1-47cb-a86d-3425711d1074 req-e4ef268c-59b7-43e4-bec0-fb00099e490c service nova] Lock "6eb5bdfc-4edd-409c-b228-f557b1aac60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e434772-83b1-47cb-a86d-3425711d1074 req-e4ef268c-59b7-43e4-bec0-fb00099e490c service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] No waiting events found dispatching network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:31 user nova-compute[75216]: WARNING nova.compute.manager [req-0e434772-83b1-47cb-a86d-3425711d1074 req-e4ef268c-59b7-43e4-bec0-fb00099e490c service nova] [instance: 6eb5bdfc-4edd-409c-b228-f557b1aac60e] Received unexpected event network-vif-plugged-bf8a785e-9ff6-4209-ab93-82c3c3adc396 for instance with vm_state deleted and task_state None.
Nov 02 05:11:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:11:33 user nova-compute[75216]: INFO nova.compute.claims [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Claim successful on node user
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:11:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.policy [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '843262c7ee264eeeaefa636bb0b87566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f6cf0694e14e73be222dfc12e2c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:11:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Creating image(s)
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:11:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.165s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk 1073741824" returned: 0 in 0.055s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Successfully created port: 3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Cannot resize image /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Ensure instance console log exists: /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Successfully updated port: 3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-changed-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Refreshing instance network info cache due to event network-changed-3432f410-eb55-42af-83be-5c46c4ba340f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance network_info: |[{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Refreshing network info cache for port 3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Start _get_guest_xml network_info=[{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:11:35 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:11:35 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:11:35 user nova-compute[75216]:   <uuid>1ad38f2e-2d94-4437-b952-06bb0df47324</uuid>
Nov 02 05:11:35 user nova-compute[75216]:   <name>instance-0000002d</name>
Nov 02 05:11:35 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:11:35 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:11:35 user nova-compute[75216]:   <metadata>
Nov 02 05:11:35 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:11:35 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:11:35 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherB-server-630037907</nova:name>
Nov 02 05:11:35 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:11:35</nova:creationTime>
Nov 02 05:11:35 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:11:35 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:11:35 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:11:35 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:11:35 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:11:35 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:11:35 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:11:35 user nova-compute[75216]:       <nova:owner>
Nov 02 05:11:35 user nova-compute[75216]:         <nova:user uuid="843262c7ee264eeeaefa636bb0b87566">tempest-ServerActionsTestOtherB-1123344217-project-member</nova:user>
Nov 02 05:11:35 user nova-compute[75216]:         <nova:project uuid="c8f6cf0694e14e73be222dfc12e2c4fa">tempest-ServerActionsTestOtherB-1123344217</nova:project>
Nov 02 05:11:35 user nova-compute[75216]:       </nova:owner>
Nov 02 05:11:35 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:11:35 user nova-compute[75216]:       <nova:ports>
Nov 02 05:11:35 user nova-compute[75216]:         <nova:port uuid="3432f410-eb55-42af-83be-5c46c4ba340f">
Nov 02 05:11:35 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 05:11:35 user nova-compute[75216]:         </nova:port>
Nov 02 05:11:35 user nova-compute[75216]:       </nova:ports>
Nov 02 05:11:35 user nova-compute[75216]:     </nova:instance>
Nov 02 05:11:35 user nova-compute[75216]:   </metadata>
Nov 02 05:11:35 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:11:35 user nova-compute[75216]:     <system>
Nov 02 05:11:35 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:11:35 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:11:35 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:11:35 user nova-compute[75216]:       <entry name="serial">1ad38f2e-2d94-4437-b952-06bb0df47324</entry>
Nov 02 05:11:35 user nova-compute[75216]:       <entry name="uuid">1ad38f2e-2d94-4437-b952-06bb0df47324</entry>
Nov 02 05:11:35 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:11:35 user nova-compute[75216]:     </system>
Nov 02 05:11:35 user nova-compute[75216]:   </sysinfo>
Nov 02 05:11:35 user nova-compute[75216]:   <os>
Nov 02 05:11:35 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:11:35 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:11:35 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:11:35 user nova-compute[75216]:   </os>
Nov 02 05:11:35 user nova-compute[75216]:   <features>
Nov 02 05:11:35 user nova-compute[75216]:     <acpi/>
Nov 02 05:11:35 user nova-compute[75216]:     <apic/>
Nov 02 05:11:35 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:11:35 user nova-compute[75216]:   </features>
Nov 02 05:11:35 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:11:35 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:11:35 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:11:35 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:11:35 user nova-compute[75216]:   </clock>
Nov 02 05:11:35 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:11:35 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:11:35 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:11:35 user nova-compute[75216]:   </cpu>
Nov 02 05:11:35 user nova-compute[75216]:   <devices>
Nov 02 05:11:35 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:11:35 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:11:35 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk"/>
Nov 02 05:11:35 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:11:35 user nova-compute[75216]:     </disk>
Nov 02 05:11:35 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:11:35 user nova-compute[75216]:       <mac address="fa:16:3e:1e:6e:0b"/>
Nov 02 05:11:35 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:11:35 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:11:35 user nova-compute[75216]:       <target dev="tap3432f410-eb"/>
Nov 02 05:11:35 user nova-compute[75216]:     </interface>
Nov 02 05:11:35 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:11:35 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/console.log" append="off"/>
Nov 02 05:11:35 user nova-compute[75216]:     </serial>
Nov 02 05:11:35 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:11:35 user nova-compute[75216]:     <video>
Nov 02 05:11:35 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:11:35 user nova-compute[75216]:     </video>
Nov 02 05:11:35 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:11:35 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:11:35 user nova-compute[75216]:     </rng>
Nov 02 05:11:35 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:11:35 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:11:35 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:11:35 user nova-compute[75216]:     </memballoon>
Nov 02 05:11:35 user nova-compute[75216]:   </devices>
Nov 02 05:11:35 user nova-compute[75216]: </domain>
Nov 02 05:11:35 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG os_vif [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5240a7f9-b708-5e60-85b3-070bc9e2e4d8', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3432f410-eb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3432f410-eb, col_values=(('qos', UUID('d046ad97-58ed-4aef-a0bc-3d38a19659b5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3432f410-eb, col_values=(('external_ids', {'iface-id': '3432f410-eb55-42af-83be-5c46c4ba340f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:6e:0b', 'vm-uuid': '1ad38f2e-2d94-4437-b952-06bb0df47324'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:35 user nova-compute[75216]: INFO os_vif [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb')
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:11:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No VIF found with MAC fa:16:3e:1e:6e:0b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:11:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updated VIF entry in instance network info cache for port 3432f410-eb55-42af-83be-5c46c4ba340f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:11:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:11:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2dfd6fc6-762c-419b-9a3e-1e436f01e5a7 req-7683ff3d-7144-4075-b2a4-f7b3f03c3d09 service nova] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:11:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-5a2f8ff3-2f6f-49d4-8e84-4a4325cad52a req-45bd46f4-44e2-4010-81c1-20c05ab97206 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5a2f8ff3-2f6f-49d4-8e84-4a4325cad52a req-45bd46f4-44e2-4010-81c1-20c05ab97206 service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5a2f8ff3-2f6f-49d4-8e84-4a4325cad52a req-45bd46f4-44e2-4010-81c1-20c05ab97206 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5a2f8ff3-2f6f-49d4-8e84-4a4325cad52a req-45bd46f4-44e2-4010-81c1-20c05ab97206 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-5a2f8ff3-2f6f-49d4-8e84-4a4325cad52a req-45bd46f4-44e2-4010-81c1-20c05ab97206 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:37 user nova-compute[75216]: WARNING nova.compute.manager [req-5a2f8ff3-2f6f-49d4-8e84-4a4325cad52a req-45bd46f4-44e2-4010-81c1-20c05ab97206 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state building and task_state spawning.
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:11:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance spawned successfully.
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:11:39 user nova-compute[75216]: INFO nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:11:39 user nova-compute[75216]: INFO nova.compute.manager [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Took 5.91 seconds to build instance.
Nov 02 05:11:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e2e61bf3-f017-443e-a6af-2f27ee060388 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-27b4da3e-e684-4b14-863d-0eea7c18f6b4 req-f33841f4-472b-4221-bceb-5956f74a27d0 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-27b4da3e-e684-4b14-863d-0eea7c18f6b4 req-f33841f4-472b-4221-bceb-5956f74a27d0 service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-27b4da3e-e684-4b14-863d-0eea7c18f6b4 req-f33841f4-472b-4221-bceb-5956f74a27d0 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-27b4da3e-e684-4b14-863d-0eea7c18f6b4 req-f33841f4-472b-4221-bceb-5956f74a27d0 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-27b4da3e-e684-4b14-863d-0eea7c18f6b4 req-f33841f4-472b-4221-bceb-5956f74a27d0 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:11:39 user nova-compute[75216]: WARNING nova.compute.manager [req-27b4da3e-e684-4b14-863d-0eea7c18f6b4 req-f33841f4-472b-4221-bceb-5956f74a27d0 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state active and task_state None.
Nov 02 05:11:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:11:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'flavor' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:11:52 user nova-compute[75216]: INFO nova.compute.manager [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Attaching volume 67cb067d-533d-4f5c-a6e5-d1e84aaaf209 to /dev/vdb
Nov 02 05:11:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a09a91-ebe6-47d8-ae98-7f1bbe531e0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c44735-9e62-4f7e-b24c-86070f6c6965]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528f0ca-1f0c-40ac-810c-186314c5d4f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf334a1-d4e1-425a-be09-9a3e6008cbe5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:11:52 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:11:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd4fed-e914-4c69-ad31-eb4955b27d31]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:11:52 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating existing volume attachment record: cf0b3a18-a606-4f0e-9602-fefd26d80ed8 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:11:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:11:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKQNdbFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:12:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:12:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:12:10 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afe0a36-254d-4789-add2-509a14052c62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:12:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678b733-a377-4982-b928-e0bcc86d470a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209] added
Nov 02 05:12:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b98d6c-7f63-4836-921a-6e57279c01c2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1dc2f2-09a4-4d7f-9a2b-d97cb83e64f1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKQNdbFp {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKQNdbFp" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e457ac-be89-4fca-8a42-283125a00ef0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKQNdbFp'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2532f8ff-1c2a-4348-883f-72a292bfdb4e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb7a286-e2e8-48c1-9e14-2d346c5b7a20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:12:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:12:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:12:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 05:12:10 user nova-compute[75216]: 
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9798c17-f057-4b5f-bec8-138462b5cb12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]
Nov 02 05:12:10 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.
Nov 02 05:12:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc066d14-9ff3-4394-960e-4d4e686564aa]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d83ac-c20e-456e-9b96-59fdfb9ff183]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31311b9-6695-441e-ad59-b4cc0e856be5]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:12:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKQNdbFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:12:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:12:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23365353531643838', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:12:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365353531643838', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:12:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'flavor' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:12:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:12:11 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:12:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:12:11 user nova-compute[75216]:   <serial>67cb067d-533d-4f5c-a6e5-d1e84aaaf209</serial>
Nov 02 05:12:11 user nova-compute[75216]: </disk>
Nov 02 05:12:11 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:12:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:12:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:12:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No VIF found with MAC fa:16:3e:1f:18:40, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:12:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3b466d6f-db41-4194-b8ee-7cd191b1711c tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.093s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:12:18 user nova-compute[75216]: INFO nova.compute.claims [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Claim successful on node user
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:12:18 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.policy [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94f0b01ce0c744bdbb937e0a477dcf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eeaefe9a0e4468d9bbb99ba3aca7c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:12:18 user nova-compute[75216]: INFO nova.virt.block_device [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Booting with volume ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a at /dev/vda
Nov 02 05:12:18 user nova-compute[75216]: DEBUG os_brick.utils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a1f28-4591-4b9d-af2a-94ce0f9817a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24b435c-43b0-4f9a-a232-bfc30f71dd87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7e1f57-088b-4bc9-b22b-4a200719fe04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e94f5ff-3eaf-42ab-ae61-4a620035b673]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:12:18 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:12:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f41b6f-b59b-4259-968b-d67db2bd2387]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG os_brick.utils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:12:18 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updating existing volume attachment record: b4783c81-dbe6-4c1f-9f49-07ebb506932b {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:12:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:19 user nova-compute[75216]: DEBUG nova.network.neutron [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Successfully created port: 54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Successfully updated port: 54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquired lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-changed-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Refreshing instance network info cache due to event network-changed-54e3673a-84ab-42ed-b84c-56454ab166bf. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] Acquiring lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updating instance_info_cache with network_info: [{"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Releasing lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Instance network_info: |[{"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] Acquired lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Refreshing network info cache for port 54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:12:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updated VIF entry in instance network info cache for port 54e3673a-84ab-42ed-b84c-56454ab166bf. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:12:21 user nova-compute[75216]: DEBUG nova.network.neutron [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updating instance_info_cache with network_info: [{"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:12:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-123169fb-f8ec-40bc-ad60-d13dd38470f6 req-6c056181-ed40-41e5-8f34-281bf718f8a1 service nova] Releasing lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:12:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-changed-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing instance network info cache due to event network-changed-854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:12:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing network info cache for port 854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:12:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated VIF entry in instance network info cache for port 854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-745bfff3-610e-4292-98f2-9660552fde37 req-509cb3fd-e7d9-4871-9d48-8bb1870acc63 service nova] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:12:27 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:12:27 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:12:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=24.9278564453125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:12:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-changed-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing instance network info cache due to event network-changed-854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing network info cache for port 854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated VIF entry in instance network info cache for port 854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-06b991e7-079f-4975-a007-3dfb29b0a774 req-b515dda6-2203-4438-9b6a-1b270e178f78 service nova] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:12:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:12:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Skipping network cache update for instance because it is Building. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:12:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:12:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:12:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:39 user nova-compute[75216]: INFO nova.compute.manager [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Rebooting instance
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:12:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Creating image(s)
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Ensure instance console log exists: /opt/stack/data/nova/instances/6bb2def8-34e6-4b4c-ab60-86f17a9a8567/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Start _get_guest_xml network_info=[{"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b4783c81-dbe6-4c1f-9f49-07ebb506932b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bb2def8-34e6-4b4c-ab60-86f17a9a8567', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'serial': 'ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:12:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:12:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:12:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:12:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:12:39 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cc7505-343c-4e6d-843f-6f87a884cb94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:12:39 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[891c9b55-f213-48a0-b5fe-8be555acb113]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a] added
Nov 02 05:12:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc03e62d-23d6-4fe3-82e9-81c020018bb1]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee4124f-a970-4afe-8daf-f4c2948ff41e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFvxXPCT {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFvxXPCT" returned: 0 in 0.032s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f04db-6d33-46e1-b539-28365ccb4659]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AFvxXPCT'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a6f449-4827-4e58-bad7-8dc56198f6f6]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b53ad8-e479-4eda-92b3-a5e3528bdd0e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c17035-5abb-43ae-8597-2d6211830f22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]
Nov 02 05:12:40 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.
Nov 02 05:12:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[159bedf6-bba1-4715-8fbe-3e08e4b027a9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c8c22c-09cc-4981-949f-2f2536245608]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:40 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f12e9b-dc38-4823-8109-b252d9233b2b]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-e84f3ace-306f-4b0a-aa56-10f30be9b81a req-50074f20-fd9f-48ba-8060-78507e1503eb service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-unplugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e84f3ace-306f-4b0a-aa56-10f30be9b81a req-50074f20-fd9f-48ba-8060-78507e1503eb service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e84f3ace-306f-4b0a-aa56-10f30be9b81a req-50074f20-fd9f-48ba-8060-78507e1503eb service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e84f3ace-306f-4b0a-aa56-10f30be9b81a req-50074f20-fd9f-48ba-8060-78507e1503eb service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-e84f3ace-306f-4b0a-aa56-10f30be9b81a req-50074f20-fd9f-48ba-8060-78507e1503eb service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-unplugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:12:40 user nova-compute[75216]: WARNING nova.compute.manager [req-e84f3ace-306f-4b0a-aa56-10f30be9b81a req-50074f20-fd9f-48ba-8060-78507e1503eb service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received unexpected event network-vif-unplugged-854fad23-cb80-4a15-8cef-194613530198 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 05:12:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance destroyed successfully.
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'resources' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-212758906',display_name='tempest-TestMinimumBasicScenario-server-212758906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-212758906',id=44,image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqz4YzavoU5vZ+Y+rciTjuVOWbnudtf9ADqs59JcpzXge9fKEI/9MeSiATWcnoxfaQCFqmXDNdhKl/Jt5bTp2Xa1Sojz6dbZqHUtyO+El9Vs2M0GFYDExX1F2FrSAhkdQ==',key_name='tempest-TestMinimumBasicScenario-200463085',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:10:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-vl3u51dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:12:40Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=399a6b48-bf68-4ae7-83e9-41e6014e8bfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_vif [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap854fad23-cb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0923c4bb-0e93-4769-8b0c-336f3f2061d9) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:12:41 user nova-compute[75216]: INFO os_vif [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb')
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26632663738323137', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632663738323137', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKQNdbFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:12:41 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625aa33-f45e-4dce-8ecd-18fb49f9932a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:12:41 user nova-compute[75216]: No targets found.
Nov 02 05:12:41 user nova-compute[75216]: iSNS:
Nov 02 05:12:41 user nova-compute[75216]: No targets found.
Nov 02 05:12:41 user nova-compute[75216]: STATIC:
Nov 02 05:12:41 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209
Nov 02 05:12:41 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:12:41 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:12:41 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:12:41 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:12:41 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:12:41 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669
Nov 02 05:12:41 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:12:41 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:12:41 user nova-compute[75216]: FIRMWARE:
Nov 02 05:12:41 user nova-compute[75216]: No targets found.
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:12:41 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:12:41 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1644282453',display_name='tempest-TestVolumeBootPattern-server-1644282453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1644282453',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-k5ibgbms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:12:19Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=6bb2def8-34e6-4b4c-ab60-86f17a9a8567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:ca,bridge_name='br-int',has_traffic_filtering=True,id=54e3673a-84ab-42ed-b84c-56454ab166bf,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54e3673a-84') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:12:41 user nova-compute[75216]:   <uuid>6bb2def8-34e6-4b4c-ab60-86f17a9a8567</uuid>
Nov 02 05:12:41 user nova-compute[75216]:   <name>instance-0000002e</name>
Nov 02 05:12:41 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:12:41 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:12:41 user nova-compute[75216]:   <metadata>
Nov 02 05:12:41 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:12:41 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:12:41 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-1644282453</nova:name>
Nov 02 05:12:41 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:12:39</nova:creationTime>
Nov 02 05:12:41 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:12:41 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:12:41 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:12:41 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:12:41 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:12:41 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:12:41 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:12:41 user nova-compute[75216]:       <nova:owner>
Nov 02 05:12:41 user nova-compute[75216]:         <nova:user uuid="94f0b01ce0c744bdbb937e0a477dcf07">tempest-TestVolumeBootPattern-773799094-project-member</nova:user>
Nov 02 05:12:41 user nova-compute[75216]:         <nova:project uuid="9eeaefe9a0e4468d9bbb99ba3aca7c64">tempest-TestVolumeBootPattern-773799094</nova:project>
Nov 02 05:12:41 user nova-compute[75216]:       </nova:owner>
Nov 02 05:12:41 user nova-compute[75216]:       <nova:ports>
Nov 02 05:12:41 user nova-compute[75216]:         <nova:port uuid="54e3673a-84ab-42ed-b84c-56454ab166bf">
Nov 02 05:12:41 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 05:12:41 user nova-compute[75216]:         </nova:port>
Nov 02 05:12:41 user nova-compute[75216]:       </nova:ports>
Nov 02 05:12:41 user nova-compute[75216]:     </nova:instance>
Nov 02 05:12:41 user nova-compute[75216]:   </metadata>
Nov 02 05:12:41 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:12:41 user nova-compute[75216]:     <system>
Nov 02 05:12:41 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:12:41 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:12:41 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:12:41 user nova-compute[75216]:       <entry name="serial">6bb2def8-34e6-4b4c-ab60-86f17a9a8567</entry>
Nov 02 05:12:41 user nova-compute[75216]:       <entry name="uuid">6bb2def8-34e6-4b4c-ab60-86f17a9a8567</entry>
Nov 02 05:12:41 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:12:41 user nova-compute[75216]:     </system>
Nov 02 05:12:41 user nova-compute[75216]:   </sysinfo>
Nov 02 05:12:41 user nova-compute[75216]:   <os>
Nov 02 05:12:41 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:12:41 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:12:41 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:12:41 user nova-compute[75216]:   </os>
Nov 02 05:12:41 user nova-compute[75216]:   <features>
Nov 02 05:12:41 user nova-compute[75216]:     <acpi/>
Nov 02 05:12:41 user nova-compute[75216]:     <apic/>
Nov 02 05:12:41 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:12:41 user nova-compute[75216]:   </features>
Nov 02 05:12:41 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:12:41 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:12:41 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:12:41 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:12:41 user nova-compute[75216]:   </clock>
Nov 02 05:12:41 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:12:41 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:12:41 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:12:41 user nova-compute[75216]:   </cpu>
Nov 02 05:12:41 user nova-compute[75216]:   <devices>
Nov 02 05:12:41 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:12:41 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:12:41 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 02 05:12:41 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:12:41 user nova-compute[75216]:       <serial>ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a</serial>
Nov 02 05:12:41 user nova-compute[75216]:     </disk>
Nov 02 05:12:41 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:12:41 user nova-compute[75216]:       <mac address="fa:16:3e:17:e4:ca"/>
Nov 02 05:12:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:12:41 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:12:41 user nova-compute[75216]:       <target dev="tap54e3673a-84"/>
Nov 02 05:12:41 user nova-compute[75216]:     </interface>
Nov 02 05:12:41 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:12:41 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/6bb2def8-34e6-4b4c-ab60-86f17a9a8567/console.log" append="off"/>
Nov 02 05:12:41 user nova-compute[75216]:     </serial>
Nov 02 05:12:41 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:12:41 user nova-compute[75216]:     <video>
Nov 02 05:12:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:12:41 user nova-compute[75216]:     </video>
Nov 02 05:12:41 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:12:41 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:12:41 user nova-compute[75216]:     </rng>
Nov 02 05:12:41 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:12:41 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:12:41 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:12:41 user nova-compute[75216]:     </memballoon>
Nov 02 05:12:41 user nova-compute[75216]:   </devices>
Nov 02 05:12:41 user nova-compute[75216]: </domain>
Nov 02 05:12:41 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1644282453',display_name='tempest-TestVolumeBootPattern-server-1644282453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1644282453',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-k5ibgbms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:12:19Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=6bb2def8-34e6-4b4c-ab60-86f17a9a8567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:ca,bridge_name='br-int',has_traffic_filtering=True,id=54e3673a-84ab-42ed-b84c-56454ab166bf,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54e3673a-84') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_vif [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:ca,bridge_name='br-int',has_traffic_filtering=True,id=54e3673a-84ab-42ed-b84c-56454ab166bf,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54e3673a-84') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96a3b600-7bec-5f0a-92b1-a4d1a372f3ff', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30ba0b5-ff15-4729-8307-e1e493ace9ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54e3673a-84, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54e3673a-84, col_values=(('qos', UUID('f10d71ab-c6d0-43cc-9380-840911095ad8')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54e3673a-84, col_values=(('external_ids', {'iface-id': '54e3673a-84ab-42ed-b84c-56454ab166bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:e4:ca', 'vm-uuid': '6bb2def8-34e6-4b4c-ab60-86f17a9a8567'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:41 user nova-compute[75216]: INFO os_vif [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:ca,bridge_name='br-int',has_traffic_filtering=True,id=54e3673a-84ab-42ed-b84c-56454ab166bf,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54e3673a-84')
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023ec12-9791-4c36-bcbd-d8bd30a72ebb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec2eaef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd374e5-61bc-4763-9af3-6e1a373fcdbe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacc6bac-c84a-466a-8e06-facbf354c7df]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No VIF found with MAC fa:16:3e:17:e4:ca, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9c18f2-44e2-479a-aae1-83e1961c4c01]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee488b3-9c66-4953-87b1-39aef2ca054a]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6bdf29-1d67-464a-8074-b52f9aed97d5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1dfd4-7d95-4b31-a48e-c0475a71c29b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]
Nov 02 05:12:41 user nova-compute[75216]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[334db0e2-81e1-400f-9bc4-d41774f10cac]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== disconnect_volume: return (326ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Start _get_guest_xml network_info=[{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'cf0b3a18-a606-4f0e-9602-fefd26d80ed8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKQNdbFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '399a6b48-bf68-4ae7-83e9-41e6014e8bfb', 'attached_at': '', 'detached_at': '', 'volume_id': '67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'serial': '67cb067d-533d-4f5c-a6e5-d1e84aaaf209'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:12:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:12:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'vcpu_model' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.objects.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Object Instance<399a6b48-bf68-4ae7-83e9-41e6014e8bfb> lazy-loaded attributes: resources,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKQNdbFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:12:41 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:12:41 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:12:41 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e509df39-bc60-4364-acb1-a94c276ad97d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:12:41 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca0e42a-16f7-476e-8282-ff05526bb1ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209] added
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1740efca-0a6f-46d1-83ea-03807dc59851]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea6f833-2647-4d9f-86a6-b12a5fe51185]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKQNdbFp {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKQNdbFp" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ac3bfd-9317-4ece-9f45-2b424fa3576b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKQNdbFp'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb264f2-b456-44fc-a39d-7e0aaa4d09f7]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1207e7-1d2b-47e1-a19f-4cec02d9dad5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea50ab-8d93-41aa-8180-466ffaa94337]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]
Nov 02 05:12:41 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df5e6e5-97c8-44f5-a6bc-309e9f1004b3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[538c3ab6-2d60-45e6-bb8e-89d17c92fa1f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691ec1e-f1c0-441a-816e-f69b9c49e669 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:12:41 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:12:41 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d4d3ea-76e9-49eb-9db7-9fdb66b22519]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:12:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-abba9231-a5da-4925-8723-e1d520d30fd1 req-ca2006c2-7e8b-47bc-8430-88c7406931cf service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abba9231-a5da-4925-8723-e1d520d30fd1 req-ca2006c2-7e8b-47bc-8430-88c7406931cf service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abba9231-a5da-4925-8723-e1d520d30fd1 req-ca2006c2-7e8b-47bc-8430-88c7406931cf service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abba9231-a5da-4925-8723-e1d520d30fd1 req-ca2006c2-7e8b-47bc-8430-88c7406931cf service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-abba9231-a5da-4925-8723-e1d520d30fd1 req-ca2006c2-7e8b-47bc-8430-88c7406931cf service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:12:42 user nova-compute[75216]: WARNING nova.compute.manager [req-abba9231-a5da-4925-8723-e1d520d30fd1 req-ca2006c2-7e8b-47bc-8430-88c7406931cf service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received unexpected event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 05:12:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-687a8e25-151e-45bd-b96e-32aed0876495 req-af036d21-e2aa-41a6-8232-2103cce2d313 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-687a8e25-151e-45bd-b96e-32aed0876495 req-af036d21-e2aa-41a6-8232-2103cce2d313 service nova] Acquiring lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-687a8e25-151e-45bd-b96e-32aed0876495 req-af036d21-e2aa-41a6-8232-2103cce2d313 service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-687a8e25-151e-45bd-b96e-32aed0876495 req-af036d21-e2aa-41a6-8232-2103cce2d313 service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-687a8e25-151e-45bd-b96e-32aed0876495 req-af036d21-e2aa-41a6-8232-2103cce2d313 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] No waiting events found dispatching network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:12:42 user nova-compute[75216]: WARNING nova.compute.manager [req-687a8e25-151e-45bd-b96e-32aed0876495 req-af036d21-e2aa-41a6-8232-2103cce2d313 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received unexpected event network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf for instance with vm_state building and task_state spawning.
Nov 02 05:12:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKQNdbFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23365353531643838', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365353531643838', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-212758906',display_name='tempest-TestMinimumBasicScenario-server-212758906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-212758906',id=44,image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqz4YzavoU5vZ+Y+rciTjuVOWbnudtf9ADqs59JcpzXge9fKEI/9MeSiATWcnoxfaQCFqmXDNdhKl/Jt5bTp2Xa1Sojz6dbZqHUtyO+El9Vs2M0GFYDExX1F2FrSAhkdQ==',key_name='tempest-TestMinimumBasicScenario-200463085',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:10:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-vl3u51dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:12:40Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=399a6b48-bf68-4ae7-83e9-41e6014e8bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'pci_devices' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Object Instance<399a6b48-bf68-4ae7-83e9-41e6014e8bfb> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:12:43 user nova-compute[75216]:   <uuid>399a6b48-bf68-4ae7-83e9-41e6014e8bfb</uuid>
Nov 02 05:12:43 user nova-compute[75216]:   <name>instance-0000002c</name>
Nov 02 05:12:43 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:12:43 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:12:43 user nova-compute[75216]:   <metadata>
Nov 02 05:12:43 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:12:43 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:12:43 user nova-compute[75216]:       <nova:name>tempest-TestMinimumBasicScenario-server-212758906</nova:name>
Nov 02 05:12:43 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:12:41</nova:creationTime>
Nov 02 05:12:43 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:12:43 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:12:43 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:12:43 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:12:43 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:12:43 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:12:43 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:12:43 user nova-compute[75216]:       <nova:owner>
Nov 02 05:12:43 user nova-compute[75216]:         <nova:user uuid="8a60b807f9454e49917d372178cc196f">tempest-TestMinimumBasicScenario-1935471528-project-member</nova:user>
Nov 02 05:12:43 user nova-compute[75216]:         <nova:project uuid="e0bbd2a0fea340eda045059153a3ed9f">tempest-TestMinimumBasicScenario-1935471528</nova:project>
Nov 02 05:12:43 user nova-compute[75216]:       </nova:owner>
Nov 02 05:12:43 user nova-compute[75216]:       <nova:root type="image" uuid="416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb"/>
Nov 02 05:12:43 user nova-compute[75216]:       <nova:ports>
Nov 02 05:12:43 user nova-compute[75216]:         <nova:port uuid="854fad23-cb80-4a15-8cef-194613530198">
Nov 02 05:12:43 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 05:12:43 user nova-compute[75216]:         </nova:port>
Nov 02 05:12:43 user nova-compute[75216]:       </nova:ports>
Nov 02 05:12:43 user nova-compute[75216]:     </nova:instance>
Nov 02 05:12:43 user nova-compute[75216]:   </metadata>
Nov 02 05:12:43 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:12:43 user nova-compute[75216]:     <system>
Nov 02 05:12:43 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:12:43 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:12:43 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:12:43 user nova-compute[75216]:       <entry name="serial">399a6b48-bf68-4ae7-83e9-41e6014e8bfb</entry>
Nov 02 05:12:43 user nova-compute[75216]:       <entry name="uuid">399a6b48-bf68-4ae7-83e9-41e6014e8bfb</entry>
Nov 02 05:12:43 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:12:43 user nova-compute[75216]:     </system>
Nov 02 05:12:43 user nova-compute[75216]:   </sysinfo>
Nov 02 05:12:43 user nova-compute[75216]:   <os>
Nov 02 05:12:43 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:12:43 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:12:43 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:12:43 user nova-compute[75216]:   </os>
Nov 02 05:12:43 user nova-compute[75216]:   <features>
Nov 02 05:12:43 user nova-compute[75216]:     <acpi/>
Nov 02 05:12:43 user nova-compute[75216]:     <apic/>
Nov 02 05:12:43 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:12:43 user nova-compute[75216]:   </features>
Nov 02 05:12:43 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:12:43 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:12:43 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:12:43 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:12:43 user nova-compute[75216]:   </clock>
Nov 02 05:12:43 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:12:43 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:12:43 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:12:43 user nova-compute[75216]:   </cpu>
Nov 02 05:12:43 user nova-compute[75216]:   <devices>
Nov 02 05:12:43 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:12:43 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:12:43 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk"/>
Nov 02 05:12:43 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:12:43 user nova-compute[75216]:     </disk>
Nov 02 05:12:43 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:12:43 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:12:43 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 05:12:43 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 05:12:43 user nova-compute[75216]:       <serial>67cb067d-533d-4f5c-a6e5-d1e84aaaf209</serial>
Nov 02 05:12:43 user nova-compute[75216]:     </disk>
Nov 02 05:12:43 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:12:43 user nova-compute[75216]:       <mac address="fa:16:3e:1f:18:40"/>
Nov 02 05:12:43 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:12:43 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:12:43 user nova-compute[75216]:       <target dev="tap854fad23-cb"/>
Nov 02 05:12:43 user nova-compute[75216]:     </interface>
Nov 02 05:12:43 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:12:43 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/console.log" append="off"/>
Nov 02 05:12:43 user nova-compute[75216]:     </serial>
Nov 02 05:12:43 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:12:43 user nova-compute[75216]:     <video>
Nov 02 05:12:43 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:12:43 user nova-compute[75216]:     </video>
Nov 02 05:12:43 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:12:43 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:12:43 user nova-compute[75216]:     </rng>
Nov 02 05:12:43 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:12:43 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:12:43 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:12:43 user nova-compute[75216]:     </memballoon>
Nov 02 05:12:43 user nova-compute[75216]:   </devices>
Nov 02 05:12:43 user nova-compute[75216]: </domain>
Nov 02 05:12:43 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'trusted_certs' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Object Instance<399a6b48-bf68-4ae7-83e9-41e6014e8bfb> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Cannot resize image /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'migration_context' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Object Instance<399a6b48-bf68-4ae7-83e9-41e6014e8bfb> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-212758906',display_name='tempest-TestMinimumBasicScenario-server-212758906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-212758906',id=44,image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqz4YzavoU5vZ+Y+rciTjuVOWbnudtf9ADqs59JcpzXge9fKEI/9MeSiATWcnoxfaQCFqmXDNdhKl/Jt5bTp2Xa1Sojz6dbZqHUtyO+El9Vs2M0GFYDExX1F2FrSAhkdQ==',key_name='tempest-TestMinimumBasicScenario-200463085',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:10:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-vl3u51dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:12:40Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=399a6b48-bf68-4ae7-83e9-41e6014e8bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG os_vif [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c20f3f83-889e-56a6-8cf5-e5efd5612b74', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap854fad23-cb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap854fad23-cb, col_values=(('qos', UUID('2fb54442-5021-4d5f-b0b9-d608e083daa3')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap854fad23-cb, col_values=(('external_ids', {'iface-id': '854fad23-cb80-4a15-8cef-194613530198', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:18:40', 'vm-uuid': '399a6b48-bf68-4ae7-83e9-41e6014e8bfb'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:43 user nova-compute[75216]: INFO os_vif [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb')
Nov 02 05:12:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:12:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:12:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-8dd8047e-a49a-4453-949f-56cf0097896b req-e501f8f2-9781-41a3-8738-9174a547e17d service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dd8047e-a49a-4453-949f-56cf0097896b req-e501f8f2-9781-41a3-8738-9174a547e17d service nova] Acquiring lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dd8047e-a49a-4453-949f-56cf0097896b req-e501f8f2-9781-41a3-8738-9174a547e17d service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dd8047e-a49a-4453-949f-56cf0097896b req-e501f8f2-9781-41a3-8738-9174a547e17d service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-8dd8047e-a49a-4453-949f-56cf0097896b req-e501f8f2-9781-41a3-8738-9174a547e17d service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] No waiting events found dispatching network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:12:44 user nova-compute[75216]: WARNING nova.compute.manager [req-8dd8047e-a49a-4453-949f-56cf0097896b req-e501f8f2-9781-41a3-8738-9174a547e17d service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received unexpected event network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf for instance with vm_state building and task_state spawning.
Nov 02 05:12:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Instance spawned successfully.
Nov 02 05:12:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:45 user nova-compute[75216]: INFO nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:12:45 user nova-compute[75216]: INFO nova.compute.manager [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Took 26.81 seconds to build instance.
Nov 02 05:12:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-83d7fca5-346a-4cc5-a7a4-9128992d7b44 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.911s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-953f2aee-d4f4-4d85-97b2-0f430decc86f req-809587e4-728f-468d-b881-a9661b0343bb service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-953f2aee-d4f4-4d85-97b2-0f430decc86f req-809587e4-728f-468d-b881-a9661b0343bb service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-953f2aee-d4f4-4d85-97b2-0f430decc86f req-809587e4-728f-468d-b881-a9661b0343bb service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-953f2aee-d4f4-4d85-97b2-0f430decc86f req-809587e4-728f-468d-b881-a9661b0343bb service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-953f2aee-d4f4-4d85-97b2-0f430decc86f req-809587e4-728f-468d-b881-a9661b0343bb service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:12:45 user nova-compute[75216]: WARNING nova.compute.manager [req-953f2aee-d4f4-4d85-97b2-0f430decc86f req-809587e4-728f-468d-b881-a9661b0343bb service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received unexpected event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 05:12:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-44b6cff6-0a85-41b9-aea9-784628b3e992 req-05073df0-eccd-449a-977e-9b9ef3a55aca service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:12:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44b6cff6-0a85-41b9-aea9-784628b3e992 req-05073df0-eccd-449a-977e-9b9ef3a55aca service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44b6cff6-0a85-41b9-aea9-784628b3e992 req-05073df0-eccd-449a-977e-9b9ef3a55aca service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44b6cff6-0a85-41b9-aea9-784628b3e992 req-05073df0-eccd-449a-977e-9b9ef3a55aca service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-44b6cff6-0a85-41b9-aea9-784628b3e992 req-05073df0-eccd-449a-977e-9b9ef3a55aca service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:12:48 user nova-compute[75216]: WARNING nova.compute.manager [req-44b6cff6-0a85-41b9-aea9-784628b3e992 req-05073df0-eccd-449a-977e-9b9ef3a55aca service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received unexpected event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 05:12:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:12:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance rebooted successfully.
Nov 02 05:12:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:12:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91033ad3-276d-4b14-843a-d78ee51d497f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.731s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:12:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:58 user nova-compute[75216]: INFO nova.compute.manager [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Unshelving
Nov 02 05:12:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:12:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:12:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'pci_requests' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:12:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:12:59 user nova-compute[75216]: INFO nova.compute.claims [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Claim successful on node user
Nov 02 05:12:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:12:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:12:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:12:59 user nova-compute[75216]: INFO nova.network.neutron [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating port 469ad201-023b-4826-b3c1-4464db75bad2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 05:13:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:13:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquired lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:13:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:13:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-changed-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:13:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing instance network info cache due to event network-changed-469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:13:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] Acquiring lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:13:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Releasing lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:13:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Creating image(s)
Nov 02 05:13:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] Acquired lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Refreshing network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG nova.objects.base [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<0ed080f2-eb48-45ce-b67b-4949672c93d4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.part --force-share --output=json" returned: 0 in 0.233s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG nova.virt.images [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] c45b25a7-30d8-48fc-aa85-7acee052c018 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.part /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updated VIF entry in instance network info cache for port 469ad201-023b-4826-b3c1-4464db75bad2. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9095e5da-21da-453b-a180-015ed10d3a83 req-b09e39ec-9d5a-4de8-9257-cbb5e6bbc62b service nova] Releasing lock "refresh_cache-0ed080f2-eb48-45ce-b67b-4949672c93d4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.part /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.converted" returned: 0 in 0.290s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.723s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3 --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3,backing_fmt=raw /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3,backing_fmt=raw /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk 1073741824" returned: 0 in 0.055s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'migration_context' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG nova.objects.base [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<0ed080f2-eb48-45ce-b67b-4949672c93d4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:13:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Rebasing disk image.
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec -F raw /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec -F raw /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk" returned: 0 in 2.155s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Start _get_guest_xml network_info=[{"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8f07cb7ae2cd0e916f0843746c1c7e07',container_format='bare',created_at=2023-11-02T05:11:04Z,direct_url=<?>,disk_format='qcow2',id=c45b25a7-30d8-48fc-aa85-7acee052c018,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-572366251-shelved',owner='ca67de068e45497ba3286b5c50da9335',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T05:11:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:13:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:13:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8f07cb7ae2cd0e916f0843746c1c7e07',container_format='bare',created_at=2023-11-02T05:11:04Z,direct_url=<?>,disk_format='qcow2',id=c45b25a7-30d8-48fc-aa85-7acee052c018,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-572366251-shelved',owner='ca67de068e45497ba3286b5c50da9335',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T05:11:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.objects.base [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<0ed080f2-eb48-45ce-b67b-4949672c93d4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T05:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-572366251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-572366251',id=41,image_ref='c45b25a7-30d8-48fc-aa85-7acee052c018',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2031242040',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-b3w5h0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member',shelved_at='2023-11-02T05:11:08.003510',shelved_host='user',shelved_image_id='c45b25a7-30d8-48fc-aa85-7acee052c018'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=0ed080f2-eb48-45ce-b67b-4949672c93d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.objects.base [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Object Instance<0ed080f2-eb48-45ce-b67b-4949672c93d4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:13:05 user nova-compute[75216]:   <uuid>0ed080f2-eb48-45ce-b67b-4949672c93d4</uuid>
Nov 02 05:13:05 user nova-compute[75216]:   <name>instance-00000029</name>
Nov 02 05:13:05 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:13:05 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:13:05 user nova-compute[75216]:   <metadata>
Nov 02 05:13:05 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:13:05 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:13:05 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-572366251</nova:name>
Nov 02 05:13:05 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:13:05</nova:creationTime>
Nov 02 05:13:05 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:13:05 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:13:05 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:13:05 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:13:05 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:13:05 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:13:05 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:13:05 user nova-compute[75216]:       <nova:owner>
Nov 02 05:13:05 user nova-compute[75216]:         <nova:user uuid="049f40a6f12742aaa3192675b09644a6">tempest-AttachVolumeShelveTestJSON-1661619051-project-member</nova:user>
Nov 02 05:13:05 user nova-compute[75216]:         <nova:project uuid="ca67de068e45497ba3286b5c50da9335">tempest-AttachVolumeShelveTestJSON-1661619051</nova:project>
Nov 02 05:13:05 user nova-compute[75216]:       </nova:owner>
Nov 02 05:13:05 user nova-compute[75216]:       <nova:root type="image" uuid="c45b25a7-30d8-48fc-aa85-7acee052c018"/>
Nov 02 05:13:05 user nova-compute[75216]:       <nova:ports>
Nov 02 05:13:05 user nova-compute[75216]:         <nova:port uuid="469ad201-023b-4826-b3c1-4464db75bad2">
Nov 02 05:13:05 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 05:13:05 user nova-compute[75216]:         </nova:port>
Nov 02 05:13:05 user nova-compute[75216]:       </nova:ports>
Nov 02 05:13:05 user nova-compute[75216]:     </nova:instance>
Nov 02 05:13:05 user nova-compute[75216]:   </metadata>
Nov 02 05:13:05 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:13:05 user nova-compute[75216]:     <system>
Nov 02 05:13:05 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:13:05 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:13:05 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:13:05 user nova-compute[75216]:       <entry name="serial">0ed080f2-eb48-45ce-b67b-4949672c93d4</entry>
Nov 02 05:13:05 user nova-compute[75216]:       <entry name="uuid">0ed080f2-eb48-45ce-b67b-4949672c93d4</entry>
Nov 02 05:13:05 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:13:05 user nova-compute[75216]:     </system>
Nov 02 05:13:05 user nova-compute[75216]:   </sysinfo>
Nov 02 05:13:05 user nova-compute[75216]:   <os>
Nov 02 05:13:05 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:13:05 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:13:05 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:13:05 user nova-compute[75216]:   </os>
Nov 02 05:13:05 user nova-compute[75216]:   <features>
Nov 02 05:13:05 user nova-compute[75216]:     <acpi/>
Nov 02 05:13:05 user nova-compute[75216]:     <apic/>
Nov 02 05:13:05 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:13:05 user nova-compute[75216]:   </features>
Nov 02 05:13:05 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:13:05 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:13:05 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:13:05 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:13:05 user nova-compute[75216]:   </clock>
Nov 02 05:13:05 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:13:05 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:13:05 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:13:05 user nova-compute[75216]:   </cpu>
Nov 02 05:13:05 user nova-compute[75216]:   <devices>
Nov 02 05:13:05 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:13:05 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:13:05 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk"/>
Nov 02 05:13:05 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:13:05 user nova-compute[75216]:     </disk>
Nov 02 05:13:05 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:13:05 user nova-compute[75216]:       <mac address="fa:16:3e:d0:a0:cc"/>
Nov 02 05:13:05 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:13:05 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:13:05 user nova-compute[75216]:       <target dev="tap469ad201-02"/>
Nov 02 05:13:05 user nova-compute[75216]:     </interface>
Nov 02 05:13:05 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:13:05 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/console.log" append="off"/>
Nov 02 05:13:05 user nova-compute[75216]:     </serial>
Nov 02 05:13:05 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:13:05 user nova-compute[75216]:     <video>
Nov 02 05:13:05 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:13:05 user nova-compute[75216]:     </video>
Nov 02 05:13:05 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:13:05 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:13:05 user nova-compute[75216]:     </rng>
Nov 02 05:13:05 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:13:05 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:13:05 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:13:05 user nova-compute[75216]:     </memballoon>
Nov 02 05:13:05 user nova-compute[75216]:   </devices>
Nov 02 05:13:05 user nova-compute[75216]: </domain>
Nov 02 05:13:05 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T05:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-572366251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-572366251',id=41,image_ref='c45b25a7-30d8-48fc-aa85-7acee052c018',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2031242040',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-b3w5h0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member',shelved_at='2023-11-02T05:11:08.003510',shelved_host='user',shelved_image_id='c45b25a7-30d8-48fc-aa85-7acee052c018'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=0ed080f2-eb48-45ce-b67b-4949672c93d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG os_vif [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8c1c891-a00b-59e7-8245-6fe5d7d8c32e', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469ad201-02, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap469ad201-02, col_values=(('qos', UUID('6e6edf64-d44e-4311-a470-b5c13324dbb2')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap469ad201-02, col_values=(('external_ids', {'iface-id': '469ad201-023b-4826-b3c1-4464db75bad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:a0:cc', 'vm-uuid': '0ed080f2-eb48-45ce-b67b-4949672c93d4'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:05 user nova-compute[75216]: INFO os_vif [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02')
Nov 02 05:13:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:13:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] No VIF found with MAC fa:16:3e:d0:a0:cc, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-8dcac9fb-d077-4046-aa99-22f0cc2c05d5 req-ae930218-5140-4547-ae10-6902d62bfd92 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dcac9fb-d077-4046-aa99-22f0cc2c05d5 req-ae930218-5140-4547-ae10-6902d62bfd92 service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dcac9fb-d077-4046-aa99-22f0cc2c05d5 req-ae930218-5140-4547-ae10-6902d62bfd92 service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8dcac9fb-d077-4046-aa99-22f0cc2c05d5 req-ae930218-5140-4547-ae10-6902d62bfd92 service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-8dcac9fb-d077-4046-aa99-22f0cc2c05d5 req-ae930218-5140-4547-ae10-6902d62bfd92 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:13:07 user nova-compute[75216]: WARNING nova.compute.manager [req-8dcac9fb-d077-4046-aa99-22f0cc2c05d5 req-ae930218-5140-4547-ae10-6902d62bfd92 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received unexpected event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 05:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-f5570674-1f9a-42d6-bb51-21acd96e82b4 req-0a5dbab1-f30c-49e4-8d1f-09b00217c660 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f5570674-1f9a-42d6-bb51-21acd96e82b4 req-0a5dbab1-f30c-49e4-8d1f-09b00217c660 service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f5570674-1f9a-42d6-bb51-21acd96e82b4 req-0a5dbab1-f30c-49e4-8d1f-09b00217c660 service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f5570674-1f9a-42d6-bb51-21acd96e82b4 req-0a5dbab1-f30c-49e4-8d1f-09b00217c660 service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-f5570674-1f9a-42d6-bb51-21acd96e82b4 req-0a5dbab1-f30c-49e4-8d1f-09b00217c660 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:13:09 user nova-compute[75216]: WARNING nova.compute.manager [req-f5570674-1f9a-42d6-bb51-21acd96e82b4 req-0a5dbab1-f30c-49e4-8d1f-09b00217c660 service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received unexpected event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 05:13:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:13:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:13:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance spawned successfully.
Nov 02 05:13:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:13:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8087a1cd-5547-4d36-b5d4-606eb08e7f18 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.110s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-changed-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:13:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Refreshing instance network info cache due to event network-changed-3432f410-eb55-42af-83be-5c46c4ba340f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:13:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:13:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:13:24 user nova-compute[75216]: DEBUG nova.network.neutron [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Refreshing network info cache for port 3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:13:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updated VIF entry in instance network info cache for port 3432f410-eb55-42af-83be-5c46c4ba340f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:13:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:13:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1803f35f-c9d0-47a6-95d7-ccd0d8e3b964 req-7835b8d0-d9d7-4bd2-940b-71ac42f7ef09 service nova] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:13:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:13:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:13:28 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:13:28 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8338MB free_disk=24.890071868896484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0ed080f2-eb48-45ce-b67b-4949672c93d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:13:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:13:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:13:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:13:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:13:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:13:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:13:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:13:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:14:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:14:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:14:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-changed-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Refreshing instance network info cache due to event network-changed-54e3673a-84ab-42ed-b84c-56454ab166bf. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] Acquiring lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] Acquired lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Refreshing network info cache for port 54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updated VIF entry in instance network info cache for port 54e3673a-84ab-42ed-b84c-56454ab166bf. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updating instance_info_cache with network_info: [{"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9eb7ab8-209d-45a1-956a-72b516220daa req-2dae47af-7e3c-4321-8cdb-d1f41aea5c45 service nova] Releasing lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:14:28 user nova-compute[75216]: INFO nova.compute.claims [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Claim successful on node user
Nov 02 05:14:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:14:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:14:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:14:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8476MB free_disk=24.88815689086914GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.894s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.256s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:14:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0ed080f2-eb48-45ce-b67b-4949672c93d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ff449ddd-ef4d-4dcc-a32f-ba6445a74260 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.policy [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94f0b01ce0c744bdbb937e0a477dcf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eeaefe9a0e4468d9bbb99ba3aca7c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:14:29 user nova-compute[75216]: INFO nova.virt.block_device [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Booting with volume d0edcc57-e6b7-47e2-a739-59314a42d808 at /dev/vda
Nov 02 05:14:29 user nova-compute[75216]: DEBUG os_brick.utils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c724eaca-3e1e-486a-8f5d-b283884d4c07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab17030b-76f6-46f8-919f-194cbd9a7493]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d10df4c-be3c-4393-b539-9ae87fb21aa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b75bc-afff-451f-8297-51d1bfeee121]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:14:29 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:14:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e00b7b-b8ba-4620-86ac-b63053f2889b]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG os_brick.utils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:14:29 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updating existing volume attachment record: 59f5e328-99e8-4404-b63e-60639049a286 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:14:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Successfully created port: 3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-changed-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing instance network info cache due to event network-changed-854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing network info cache for port 854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Successfully updated port: 3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquired lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-changed-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Refreshing instance network info cache due to event network-changed-3e024723-b403-4472-b6ef-2208f683c89d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] Acquiring lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated VIF entry in instance network info cache for port 854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-917f4240-1ccf-476d-bdb6-2d2c99cb7b30 req-60c57339-4939-41c0-a4ed-1325aa3a9a77 service nova] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lazy-loading 'flavor' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updating instance_info_cache with network_info: [{"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Releasing lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Instance network_info: |[{"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] Acquired lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Refreshing network info cache for port 3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:32 user nova-compute[75216]: INFO nova.compute.manager [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Attaching volume 58054ab4-c4a9-4cdc-a14d-fc425fee249f to /dev/vdb
Nov 02 05:14:32 user nova-compute[75216]: DEBUG os_brick.utils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf039a34-e9a1-4c2c-a07c-3da33c01b241]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[319af139-add5-4191-be17-2c56dc7718fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[191c6571-7e16-4aba-a6a5-043769840276]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c7132-9296-4d1e-b062-0699a10802a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:14:32 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:14:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f82993-788d-473b-8a5c-da98dac279a5]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG os_brick.utils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:14:32 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating existing volume attachment record: c73ec96a-fb63-472c-91ca-f8efd9e94a00 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:33 user nova-compute[75216]: INFO nova.compute.manager [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Detaching volume 67cb067d-533d-4f5c-a6e5-d1e84aaaf209
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updated VIF entry in instance network info cache for port 3e024723-b403-4472-b6ef-2208f683c89d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updating instance_info_cache with network_info: [{"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-77035901-7403-4208-8eef-b45ad137f993 req-e9fbfdf6-d35a-4c85-8ca9-7a142b6f9c6d service nova] Releasing lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:33 user nova-compute[75216]: INFO nova.virt.block_device [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Attempting to driver detach volume 67cb067d-533d-4f5c-a6e5-d1e84aaaf209 from mountpoint /dev/vdb
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Attempting to detach device vdb from instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:14:33 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:14:33 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:14:33 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:14:33 user nova-compute[75216]:   <serial>67cb067d-533d-4f5c-a6e5-d1e84aaaf209</serial>
Nov 02 05:14:33 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 05:14:33 user nova-compute[75216]: </disk>
Nov 02 05:14:33 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:14:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully detached device vdb from instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb from the persistent domain config.
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:14:33 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:14:33 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:14:33 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:14:33 user nova-compute[75216]:   <serial>67cb067d-533d-4f5c-a6e5-d1e84aaaf209</serial>
Nov 02 05:14:33 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 05:14:33 user nova-compute[75216]: </disk>
Nov 02 05:14:33 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-changed-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing instance network info cache due to event network-changed-854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Refreshing network info cache for port 854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:14:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated VIF entry in instance network info cache for port 854fad23-cb80-4a15-8cef-194613530198. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:14:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c7ee002-d7d0-40f9-af1f-26b8a635b07d req-6a267ea9-71f2-4ecb-a9f6-0c9d4b75d148 service nova] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Skipping network cache update for instance because it is Building. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:14:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [{"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-399a6b48-bf68-4ae7-83e9-41e6014e8bfb" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:14:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:14:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:14:41 user nova-compute[75216]: INFO nova.compute.claims [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Claim successful on node user
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:14:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.policy [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '058db2cf6570427080519cc52bfed93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9eab54566941b3b4cc60a56b149161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:14:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Creating image(s)
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "/opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "/opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk 1073741824" returned: 0 in 0.047s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Successfully created port: e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Cannot resize image /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Ensure instance console log exists: /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Successfully updated port: e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquired lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-changed-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Refreshing instance network info cache due to event network-changed-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] Acquiring lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating instance_info_cache with network_info: [{"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Releasing lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Instance network_info: |[{"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] Acquired lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Refreshing network info cache for port e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Start _get_guest_xml network_info=[{"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:14:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:14:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-680841892',display_name='tempest-SnapshotDataIntegrityTests-server-680841892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-680841892',id=48,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYIcsfQ185MxeKTyax5aGCk+2wxKwSgKakDCY4qpvTuaJ+KN8tiFOU9H+Ak2xYKlKQB66n8iAI4jh9U54YFtt1DEqT2JSMXVwIPbnQXQYWgccWDvdXHt8ojsDnPKbBlBQ==',key_name='tempest-keypair-256835962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b9eab54566941b3b4cc60a56b149161',ramdisk_id='',reservation_id='r-9e2qd0kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-403700980',owner_user_name='tempest-SnapshotDataIntegrityTests-403700980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='058db2cf6570427080519cc52bfed93b',uuid=0bf3440c-094c-4748-ba82-6502decfd65c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Converting VIF {"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:3b,bridge_name='br-int',has_traffic_filtering=True,id=e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811,network=Network(21f6c571-3800-4bf2-901d-1979a5f766fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8bb44b8-d4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:14:44 user nova-compute[75216]:   <uuid>0bf3440c-094c-4748-ba82-6502decfd65c</uuid>
Nov 02 05:14:44 user nova-compute[75216]:   <name>instance-00000030</name>
Nov 02 05:14:44 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:14:44 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:14:44 user nova-compute[75216]:   <metadata>
Nov 02 05:14:44 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:14:44 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:14:44 user nova-compute[75216]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-680841892</nova:name>
Nov 02 05:14:44 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:14:44</nova:creationTime>
Nov 02 05:14:44 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:14:44 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:14:44 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:14:44 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:14:44 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:14:44 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:14:44 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:14:44 user nova-compute[75216]:       <nova:owner>
Nov 02 05:14:44 user nova-compute[75216]:         <nova:user uuid="058db2cf6570427080519cc52bfed93b">tempest-SnapshotDataIntegrityTests-403700980-project-member</nova:user>
Nov 02 05:14:44 user nova-compute[75216]:         <nova:project uuid="9b9eab54566941b3b4cc60a56b149161">tempest-SnapshotDataIntegrityTests-403700980</nova:project>
Nov 02 05:14:44 user nova-compute[75216]:       </nova:owner>
Nov 02 05:14:44 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:14:44 user nova-compute[75216]:       <nova:ports>
Nov 02 05:14:44 user nova-compute[75216]:         <nova:port uuid="e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811">
Nov 02 05:14:44 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 05:14:44 user nova-compute[75216]:         </nova:port>
Nov 02 05:14:44 user nova-compute[75216]:       </nova:ports>
Nov 02 05:14:44 user nova-compute[75216]:     </nova:instance>
Nov 02 05:14:44 user nova-compute[75216]:   </metadata>
Nov 02 05:14:44 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:14:44 user nova-compute[75216]:     <system>
Nov 02 05:14:44 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:14:44 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:14:44 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:14:44 user nova-compute[75216]:       <entry name="serial">0bf3440c-094c-4748-ba82-6502decfd65c</entry>
Nov 02 05:14:44 user nova-compute[75216]:       <entry name="uuid">0bf3440c-094c-4748-ba82-6502decfd65c</entry>
Nov 02 05:14:44 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:14:44 user nova-compute[75216]:     </system>
Nov 02 05:14:44 user nova-compute[75216]:   </sysinfo>
Nov 02 05:14:44 user nova-compute[75216]:   <os>
Nov 02 05:14:44 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:14:44 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:14:44 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:14:44 user nova-compute[75216]:   </os>
Nov 02 05:14:44 user nova-compute[75216]:   <features>
Nov 02 05:14:44 user nova-compute[75216]:     <acpi/>
Nov 02 05:14:44 user nova-compute[75216]:     <apic/>
Nov 02 05:14:44 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:14:44 user nova-compute[75216]:   </features>
Nov 02 05:14:44 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:14:44 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:14:44 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:14:44 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:14:44 user nova-compute[75216]:   </clock>
Nov 02 05:14:44 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:14:44 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:14:44 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:14:44 user nova-compute[75216]:   </cpu>
Nov 02 05:14:44 user nova-compute[75216]:   <devices>
Nov 02 05:14:44 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:14:44 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:14:44 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk"/>
Nov 02 05:14:44 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:14:44 user nova-compute[75216]:     </disk>
Nov 02 05:14:44 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:14:44 user nova-compute[75216]:       <mac address="fa:16:3e:e1:57:3b"/>
Nov 02 05:14:44 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:14:44 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:14:44 user nova-compute[75216]:       <target dev="tape8bb44b8-d4"/>
Nov 02 05:14:44 user nova-compute[75216]:     </interface>
Nov 02 05:14:44 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:14:44 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/console.log" append="off"/>
Nov 02 05:14:44 user nova-compute[75216]:     </serial>
Nov 02 05:14:44 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:14:44 user nova-compute[75216]:     <video>
Nov 02 05:14:44 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:14:44 user nova-compute[75216]:     </video>
Nov 02 05:14:44 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:14:44 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:14:44 user nova-compute[75216]:     </rng>
Nov 02 05:14:44 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:14:44 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:14:44 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:14:44 user nova-compute[75216]:     </memballoon>
Nov 02 05:14:44 user nova-compute[75216]:   </devices>
Nov 02 05:14:44 user nova-compute[75216]: </domain>
Nov 02 05:14:44 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-680841892',display_name='tempest-SnapshotDataIntegrityTests-server-680841892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-680841892',id=48,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYIcsfQ185MxeKTyax5aGCk+2wxKwSgKakDCY4qpvTuaJ+KN8tiFOU9H+Ak2xYKlKQB66n8iAI4jh9U54YFtt1DEqT2JSMXVwIPbnQXQYWgccWDvdXHt8ojsDnPKbBlBQ==',key_name='tempest-keypair-256835962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b9eab54566941b3b4cc60a56b149161',ramdisk_id='',reservation_id='r-9e2qd0kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-403700980',owner_user_name='tempest-SnapshotDataIntegrityTests-403700980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='058db2cf6570427080519cc52bfed93b',uuid=0bf3440c-094c-4748-ba82-6502decfd65c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Converting VIF {"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:3b,bridge_name='br-int',has_traffic_filtering=True,id=e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811,network=Network(21f6c571-3800-4bf2-901d-1979a5f766fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8bb44b8-d4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG os_vif [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:3b,bridge_name='br-int',has_traffic_filtering=True,id=e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811,network=Network(21f6c571-3800-4bf2-901d-1979a5f766fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8bb44b8-d4') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c6aaa86-27c1-5194-a9c7-2831f5acafb0', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8bb44b8-d4, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8bb44b8-d4, col_values=(('qos', UUID('3f68e84e-2c37-4a57-b4c8-659545269dc4')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8bb44b8-d4, col_values=(('external_ids', {'iface-id': 'e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:57:3b', 'vm-uuid': '0bf3440c-094c-4748-ba82-6502decfd65c'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:44 user nova-compute[75216]: INFO os_vif [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:3b,bridge_name='br-int',has_traffic_filtering=True,id=e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811,network=Network(21f6c571-3800-4bf2-901d-1979a5f766fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8bb44b8-d4')
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No VIF found with MAC fa:16:3e:e1:57:3b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updated VIF entry in instance network info cache for port e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating instance_info_cache with network_info: [{"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f372ae3-926c-4c5f-af08-1e6cd3908373 req-3ee00a96-1e95-4100-8537-ff6a181e3923 service nova] Releasing lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-af110953-4ae0-43bc-b8a4-7ebade2ca858 req-5d1c5e14-8f74-4472-97aa-090106bb742a service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af110953-4ae0-43bc-b8a4-7ebade2ca858 req-5d1c5e14-8f74-4472-97aa-090106bb742a service nova] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af110953-4ae0-43bc-b8a4-7ebade2ca858 req-5d1c5e14-8f74-4472-97aa-090106bb742a service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af110953-4ae0-43bc-b8a4-7ebade2ca858 req-5d1c5e14-8f74-4472-97aa-090106bb742a service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-af110953-4ae0-43bc-b8a4-7ebade2ca858 req-5d1c5e14-8f74-4472-97aa-090106bb742a service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] No waiting events found dispatching network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:14:45 user nova-compute[75216]: WARNING nova.compute.manager [req-af110953-4ae0-43bc-b8a4-7ebade2ca858 req-5d1c5e14-8f74-4472-97aa-090106bb742a service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received unexpected event network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 for instance with vm_state building and task_state spawning.
Nov 02 05:14:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:14:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Instance spawned successfully.
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d30be50-c8d6-43c8-86ba-cbf68493df28 req-ba581ab3-8ef8-4cc6-8115-76873c459c19 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d30be50-c8d6-43c8-86ba-cbf68493df28 req-ba581ab3-8ef8-4cc6-8115-76873c459c19 service nova] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d30be50-c8d6-43c8-86ba-cbf68493df28 req-ba581ab3-8ef8-4cc6-8115-76873c459c19 service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d30be50-c8d6-43c8-86ba-cbf68493df28 req-ba581ab3-8ef8-4cc6-8115-76873c459c19 service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d30be50-c8d6-43c8-86ba-cbf68493df28 req-ba581ab3-8ef8-4cc6-8115-76873c459c19 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] No waiting events found dispatching network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:14:47 user nova-compute[75216]: WARNING nova.compute.manager [req-3d30be50-c8d6-43c8-86ba-cbf68493df28 req-ba581ab3-8ef8-4cc6-8115-76873c459c19 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received unexpected event network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 for instance with vm_state building and task_state spawning.
Nov 02 05:14:47 user nova-compute[75216]: INFO nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 02 05:14:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:14:47 user nova-compute[75216]: INFO nova.compute.manager [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Took 6.24 seconds to build instance.
Nov 02 05:14:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6ed123d-61f1-4a04-938c-b4257a71f8d5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:48 user nova-compute[75216]: INFO nova.compute.manager [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Terminating instance
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-1805ed71-a9c9-40be-af2f-465bff133638 req-d9a83bf7-c587-408a-8472-7d424046078d service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-unplugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1805ed71-a9c9-40be-af2f-465bff133638 req-d9a83bf7-c587-408a-8472-7d424046078d service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1805ed71-a9c9-40be-af2f-465bff133638 req-d9a83bf7-c587-408a-8472-7d424046078d service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1805ed71-a9c9-40be-af2f-465bff133638 req-d9a83bf7-c587-408a-8472-7d424046078d service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-1805ed71-a9c9-40be-af2f-465bff133638 req-d9a83bf7-c587-408a-8472-7d424046078d service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-unplugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-1805ed71-a9c9-40be-af2f-465bff133638 req-d9a83bf7-c587-408a-8472-7d424046078d service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-unplugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Instance destroyed successfully.
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lazy-loading 'resources' on Instance uuid 0ed080f2-eb48-45ce-b67b-4949672c93d4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T05:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-572366251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-572366251',id=41,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgGW7yb4icMqF0naGl12n9jNQKOz1BnQrpbCXIwCkukV0UuDJ05ZpTXSEtqOmUmdxm/buWQd/ojVUrl/WLxM/YN1W/OBdYXk/49Roibr2rM2z85bm3DtA+aueFHdpTXYQ==',key_name='tempest-keypair-2031242040',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:13:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca67de068e45497ba3286b5c50da9335',ramdisk_id='',reservation_id='r-b3w5h0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1661619051',owner_user_name='tempest-AttachVolumeShelveTestJSON-1661619051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:13:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='049f40a6f12742aaa3192675b09644a6',uuid=0ed080f2-eb48-45ce-b67b-4949672c93d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converting VIF {"id": "469ad201-023b-4826-b3c1-4464db75bad2", "address": "fa:16:3e:d0:a0:cc", "network": {"id": "0ca99782-be93-4900-878b-e8a8525478af", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834394763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca67de068e45497ba3286b5c50da9335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469ad201-02", "ovs_interfaceid": "469ad201-023b-4826-b3c1-4464db75bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG os_vif [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469ad201-02, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e6edf64-d44e-4311-a470-b5c13324dbb2) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:48 user nova-compute[75216]: INFO os_vif [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a0:cc,bridge_name='br-int',has_traffic_filtering=True,id=469ad201-023b-4826-b3c1-4464db75bad2,network=Network(0ca99782-be93-4900-878b-e8a8525478af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469ad201-02')
Nov 02 05:14:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Deleting instance files /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4_del
Nov 02 05:14:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Deletion of /opt/stack/data/nova/instances/0ed080f2-eb48-45ce-b67b-4949672c93d4_del complete
Nov 02 05:14:48 user nova-compute[75216]: INFO nova.compute.manager [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 02 05:14:48 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:14:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:14:49 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:49 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Took 0.82 seconds to deallocate network for instance.
Nov 02 05:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:50 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Deleted allocations for instance 0ed080f2-eb48-45ce-b67b-4949672c93d4
Nov 02 05:14:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-979c8cb3-9afa-480d-8fff-d82a3bf55a83 req-6a5348c7-d59e-4e01-a10f-cd65064082bc service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-979c8cb3-9afa-480d-8fff-d82a3bf55a83 req-6a5348c7-d59e-4e01-a10f-cd65064082bc service nova] Acquiring lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-979c8cb3-9afa-480d-8fff-d82a3bf55a83 req-6a5348c7-d59e-4e01-a10f-cd65064082bc service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-979c8cb3-9afa-480d-8fff-d82a3bf55a83 req-6a5348c7-d59e-4e01-a10f-cd65064082bc service nova] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-979c8cb3-9afa-480d-8fff-d82a3bf55a83 req-6a5348c7-d59e-4e01-a10f-cd65064082bc service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] No waiting events found dispatching network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:14:50 user nova-compute[75216]: WARNING nova.compute.manager [req-979c8cb3-9afa-480d-8fff-d82a3bf55a83 req-6a5348c7-d59e-4e01-a10f-cd65064082bc service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received unexpected event network-vif-plugged-469ad201-023b-4826-b3c1-4464db75bad2 for instance with vm_state deleted and task_state None.
Nov 02 05:14:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-979c8cb3-9afa-480d-8fff-d82a3bf55a83 req-6a5348c7-d59e-4e01-a10f-cd65064082bc service nova] [instance: 0ed080f2-eb48-45ce-b67b-4949672c93d4] Received event network-vif-deleted-469ad201-023b-4826-b3c1-4464db75bad2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2ee11fc2-c099-4953-b8f4-19bdad47cd20 tempest-AttachVolumeShelveTestJSON-1661619051 tempest-AttachVolumeShelveTestJSON-1661619051-project-member] Lock "0ed080f2-eb48-45ce-b67b-4949672c93d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.345s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:14:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Creating image(s)
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Ensure instance console log exists: /opt/stack/data/nova/instances/ff449ddd-ef4d-4dcc-a32f-ba6445a74260/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Start _get_guest_xml network_info=[{"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '59f5e328-99e8-4404-b63e-60639049a286', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wENMmpgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff449ddd-ef4d-4dcc-a32f-ba6445a74260', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0edcc57-e6b7-47e2-a739-59314a42d808', 'serial': 'd0edcc57-e6b7-47e2-a739-59314a42d808'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:14:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:14:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wENMmpgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:14:51 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:14:51 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:14:51 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3d08f1-1425-4d47-a1ff-a79870f42f33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:14:51 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c04c9-8287-4ac7-b268-5eb564407a18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808] added
Nov 02 05:14:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[278d26ec-b499-4f84-b7ef-1c44fd69d4fa]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bca9e9-1ac9-4d2d-96f9-1a5709fa6600]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wENMmpgC {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wENMmpgC" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f3d95-12c6-490a-874f-a28482ec89a8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wENMmpgC'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[da941aaa-cd0d-4707-bece-95fca00988e3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbb904e-7e0a-453c-8653-33d3ee3d8f6c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:51 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:51 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af06470a-e952-46de-820a-e27c305b35b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260]
Nov 02 05:14:51 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260] successful.
Nov 02 05:14:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ca522-3e4d-41ae-b657-53231917c3ac]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd2b6c6-f4e2-473a-aa3a-82daa43a0c95]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:51 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:51 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:51 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:51 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a992fb3-e002-4f89-bd66-9a2d67d35c20]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wENMmpgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23961613639333334', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961613639333334', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1028813084',display_name='tempest-TestVolumeBootPattern-server-1028813084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1028813084',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-pcnhrvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:14:30Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=ff449ddd-ef4d-4dcc-a32f-ba6445a74260,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:b1,bridge_name='br-int',has_traffic_filtering=True,id=3e024723-b403-4472-b6ef-2208f683c89d,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e024723-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'pci_devices' on Instance uuid ff449ddd-ef4d-4dcc-a32f-ba6445a74260 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:14:52 user nova-compute[75216]:   <uuid>ff449ddd-ef4d-4dcc-a32f-ba6445a74260</uuid>
Nov 02 05:14:52 user nova-compute[75216]:   <name>instance-0000002f</name>
Nov 02 05:14:52 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:14:52 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:14:52 user nova-compute[75216]:   <metadata>
Nov 02 05:14:52 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:14:52 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:14:52 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-1028813084</nova:name>
Nov 02 05:14:52 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:14:51</nova:creationTime>
Nov 02 05:14:52 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:14:52 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:14:52 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:14:52 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:14:52 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:14:52 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:14:52 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:14:52 user nova-compute[75216]:       <nova:owner>
Nov 02 05:14:52 user nova-compute[75216]:         <nova:user uuid="94f0b01ce0c744bdbb937e0a477dcf07">tempest-TestVolumeBootPattern-773799094-project-member</nova:user>
Nov 02 05:14:52 user nova-compute[75216]:         <nova:project uuid="9eeaefe9a0e4468d9bbb99ba3aca7c64">tempest-TestVolumeBootPattern-773799094</nova:project>
Nov 02 05:14:52 user nova-compute[75216]:       </nova:owner>
Nov 02 05:14:52 user nova-compute[75216]:       <nova:ports>
Nov 02 05:14:52 user nova-compute[75216]:         <nova:port uuid="3e024723-b403-4472-b6ef-2208f683c89d">
Nov 02 05:14:52 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 05:14:52 user nova-compute[75216]:         </nova:port>
Nov 02 05:14:52 user nova-compute[75216]:       </nova:ports>
Nov 02 05:14:52 user nova-compute[75216]:     </nova:instance>
Nov 02 05:14:52 user nova-compute[75216]:   </metadata>
Nov 02 05:14:52 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:14:52 user nova-compute[75216]:     <system>
Nov 02 05:14:52 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:14:52 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:14:52 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:14:52 user nova-compute[75216]:       <entry name="serial">ff449ddd-ef4d-4dcc-a32f-ba6445a74260</entry>
Nov 02 05:14:52 user nova-compute[75216]:       <entry name="uuid">ff449ddd-ef4d-4dcc-a32f-ba6445a74260</entry>
Nov 02 05:14:52 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:14:52 user nova-compute[75216]:     </system>
Nov 02 05:14:52 user nova-compute[75216]:   </sysinfo>
Nov 02 05:14:52 user nova-compute[75216]:   <os>
Nov 02 05:14:52 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:14:52 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:14:52 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:14:52 user nova-compute[75216]:   </os>
Nov 02 05:14:52 user nova-compute[75216]:   <features>
Nov 02 05:14:52 user nova-compute[75216]:     <acpi/>
Nov 02 05:14:52 user nova-compute[75216]:     <apic/>
Nov 02 05:14:52 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:14:52 user nova-compute[75216]:   </features>
Nov 02 05:14:52 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:14:52 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:14:52 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:14:52 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:14:52 user nova-compute[75216]:   </clock>
Nov 02 05:14:52 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:14:52 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:14:52 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:14:52 user nova-compute[75216]:   </cpu>
Nov 02 05:14:52 user nova-compute[75216]:   <devices>
Nov 02 05:14:52 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:14:52 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:14:52 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 02 05:14:52 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:14:52 user nova-compute[75216]:       <serial>d0edcc57-e6b7-47e2-a739-59314a42d808</serial>
Nov 02 05:14:52 user nova-compute[75216]:     </disk>
Nov 02 05:14:52 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:14:52 user nova-compute[75216]:       <mac address="fa:16:3e:5f:1b:b1"/>
Nov 02 05:14:52 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:14:52 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:14:52 user nova-compute[75216]:       <target dev="tap3e024723-b4"/>
Nov 02 05:14:52 user nova-compute[75216]:     </interface>
Nov 02 05:14:52 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:14:52 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/ff449ddd-ef4d-4dcc-a32f-ba6445a74260/console.log" append="off"/>
Nov 02 05:14:52 user nova-compute[75216]:     </serial>
Nov 02 05:14:52 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:14:52 user nova-compute[75216]:     <video>
Nov 02 05:14:52 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:14:52 user nova-compute[75216]:     </video>
Nov 02 05:14:52 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:14:52 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:14:52 user nova-compute[75216]:     </rng>
Nov 02 05:14:52 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:14:52 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:14:52 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:14:52 user nova-compute[75216]:     </memballoon>
Nov 02 05:14:52 user nova-compute[75216]:   </devices>
Nov 02 05:14:52 user nova-compute[75216]: </domain>
Nov 02 05:14:52 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1028813084',display_name='tempest-TestVolumeBootPattern-server-1028813084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1028813084',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-pcnhrvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:14:30Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=ff449ddd-ef4d-4dcc-a32f-ba6445a74260,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:b1,bridge_name='br-int',has_traffic_filtering=True,id=3e024723-b403-4472-b6ef-2208f683c89d,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e024723-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG os_vif [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:b1,bridge_name='br-int',has_traffic_filtering=True,id=3e024723-b403-4472-b6ef-2208f683c89d,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e024723-b4') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37afd6a0-2e28-52f9-9fd2-ce4a41bd80a3', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e024723-b4, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e024723-b4, col_values=(('qos', UUID('6a1e93fe-f0f7-426a-a029-2ed616aaa1ff')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e024723-b4, col_values=(('external_ids', {'iface-id': '3e024723-b403-4472-b6ef-2208f683c89d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:1b:b1', 'vm-uuid': 'ff449ddd-ef4d-4dcc-a32f-ba6445a74260'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:52 user nova-compute[75216]: INFO os_vif [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:b1,bridge_name='br-int',has_traffic_filtering=True,id=3e024723-b403-4472-b6ef-2208f683c89d,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e024723-b4')
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:14:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] No VIF found with MAC fa:16:3e:5f:1b:b1, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:14:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:14:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:14:53 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8ec43-e830-4d74-afd6-d3b3a49f443e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:14:53 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d7fe8c-447f-4ff6-a49c-70faafffc6fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f] added
Nov 02 05:14:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e68898-6309-40b9-ab08-689ed4f729cd]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f6cd43-95eb-46a1-a4c4-40d9db009f93]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjyWniuh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb is timed out.
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjyWniuh" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b377dfe5-442b-4bd3-b0fc-9696d9f4a3b2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjyWniuh'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully detached device vdb from instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb from the live domain config.
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKQNdbFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:14:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6be74-8bd0-49a1-b5a0-0141ebb6c1a8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e34d8fa-1ca9-4a84-9145-22e8c2cfddc4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a04256-aeb5-4447-b618-1a8d45dcdec8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]
Nov 02 05:14:53 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.
Nov 02 05:14:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6316fa8e-928a-4db7-8bfa-a3eed7a473f3]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954c07d-923d-4cbf-9695-93b368a40388]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:14:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:53 user nova-compute[75216]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:14:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9854dabf-d5c0-4b56-a1a5-a4c3e80ea240]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-333a4f82-a44c-4fac-8ed4-38c65ca82bcb req-88848b93-1d19-423d-bd03-edbfb5f76d44 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-333a4f82-a44c-4fac-8ed4-38c65ca82bcb req-88848b93-1d19-423d-bd03-edbfb5f76d44 service nova] Acquiring lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-333a4f82-a44c-4fac-8ed4-38c65ca82bcb req-88848b93-1d19-423d-bd03-edbfb5f76d44 service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-333a4f82-a44c-4fac-8ed4-38c65ca82bcb req-88848b93-1d19-423d-bd03-edbfb5f76d44 service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-333a4f82-a44c-4fac-8ed4-38c65ca82bcb req-88848b93-1d19-423d-bd03-edbfb5f76d44 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] No waiting events found dispatching network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:14:54 user nova-compute[75216]: WARNING nova.compute.manager [req-333a4f82-a44c-4fac-8ed4-38c65ca82bcb req-88848b93-1d19-423d-bd03-edbfb5f76d44 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received unexpected event network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d for instance with vm_state building and task_state spawning.
Nov 02 05:14:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26261373564613535', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261373564613535', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.205s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lazy-loading 'flavor' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d75f5c4-9199-4d49-893a-50ad6cee8fcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:14:54 user nova-compute[75216]: No targets found.
Nov 02 05:14:54 user nova-compute[75216]: iSNS:
Nov 02 05:14:54 user nova-compute[75216]: No targets found.
Nov 02 05:14:54 user nova-compute[75216]: STATIC:
Nov 02 05:14:54 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209
Nov 02 05:14:54 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:14:54 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:14:54 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:14:54 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:14:54 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:14:54 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:14:54 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:14:54 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:14:54 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808
Nov 02 05:14:54 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:14:54 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:14:54 user nova-compute[75216]: FIRMWARE:
Nov 02 05:14:54 user nova-compute[75216]: No targets found.
Nov 02 05:14:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:14:54 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:14:54 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:14:54 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:14:54 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 02 05:14:54 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:14:54 user nova-compute[75216]:   <serial>58054ab4-c4a9-4cdc-a14d-fc425fee249f</serial>
Nov 02 05:14:54 user nova-compute[75216]: </disk>
Nov 02 05:14:54 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe3cb24-fc64-4c66-b402-ba16aa3b88a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[129988eb-2bed-4222-a5db-3b3a0e81f9b2]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:54 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:54 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:54 user nova-compute[75216]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:14:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:54 user nova-compute[75216]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 (non-flash)
Nov 02 05:14:54 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:54 user nova-compute[75216]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:14:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec3ace50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2e9c54-3b3c-4a0d-b901-865d112502bc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f825bb4-07d1-40bc-8c00-9953ad5ed8f0]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0bb11b-4017-4f3e-85ee-7a6c737a2f82]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2282a14-dfd8-47c1-bed6-2fcbc94e19b1]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3708702-2f78-4f4a-8a3d-ce0221c7e2ed]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c5cc4-89b8-480a-bf13-29e22848ed71]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260]
Nov 02 05:14:55 user nova-compute[75216]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209, portal: 172.16.0.220,3260] successful.
Nov 02 05:14:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67cb067d-533d-4f5c-a6e5-d1e84aaaf209 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e76227-0bce-4d2d-a7d6-2fb619b52fd9]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== disconnect_volume: return (1507ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No VIF found with MAC fa:16:3e:1e:6e:0b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:14:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-125969c2-21fa-4366-9c06-ef95e1763aff tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.744s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3847e3ea-f70b-45b8-a843-4c169c66a844 req-d3c7bb03-fc6d-452a-a4e4-32f782aeb777 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3847e3ea-f70b-45b8-a843-4c169c66a844 req-d3c7bb03-fc6d-452a-a4e4-32f782aeb777 service nova] Acquiring lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3847e3ea-f70b-45b8-a843-4c169c66a844 req-d3c7bb03-fc6d-452a-a4e4-32f782aeb777 service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3847e3ea-f70b-45b8-a843-4c169c66a844 req-d3c7bb03-fc6d-452a-a4e4-32f782aeb777 service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3847e3ea-f70b-45b8-a843-4c169c66a844 req-d3c7bb03-fc6d-452a-a4e4-32f782aeb777 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] No waiting events found dispatching network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:14:56 user nova-compute[75216]: WARNING nova.compute.manager [req-3847e3ea-f70b-45b8-a843-4c169c66a844 req-d3c7bb03-fc6d-452a-a4e4-32f782aeb777 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received unexpected event network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d for instance with vm_state building and task_state spawning.
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:14:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Instance spawned successfully.
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'flavor' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:14:56 user nova-compute[75216]: INFO nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 02 05:14:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:14:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-53fc6f4d-2cd9-4da8-8d9c-fcf75284ffa2 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.210s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:56 user nova-compute[75216]: INFO nova.compute.manager [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Took 27.92 seconds to build instance.
Nov 02 05:14:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f118bbcb-077c-43b6-b260-b8e3aeb52251 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.033s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Stashing vm_state: active {{(pid=75216) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Nov 02 05:14:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:14:57 user nova-compute[75216]: INFO nova.compute.claims [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Claim successful on node user
Nov 02 05:14:57 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating resource usage from migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9
Nov 02 05:14:58 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.335s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:58 user nova-compute[75216]: INFO nova.compute.manager [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Migrating
Nov 02 05:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Starting migrate_disk_and_power_off {{(pid=75216) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-e8b2b2c0-1b58-4944-80fe-e8ac2c0c74cf req-693042ac-94da-4dcb-818c-8c73b2fda944 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e8b2b2c0-1b58-4944-80fe-e8ac2c0c74cf req-693042ac-94da-4dcb-818c-8c73b2fda944 service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e8b2b2c0-1b58-4944-80fe-e8ac2c0c74cf req-693042ac-94da-4dcb-818c-8c73b2fda944 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e8b2b2c0-1b58-4944-80fe-e8ac2c0c74cf req-693042ac-94da-4dcb-818c-8c73b2fda944 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-e8b2b2c0-1b58-4944-80fe-e8ac2c0c74cf req-693042ac-94da-4dcb-818c-8c73b2fda944 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:14:59 user nova-compute[75216]: WARNING nova.compute.manager [req-e8b2b2c0-1b58-4944-80fe-e8ac2c0c74cf req-693042ac-94da-4dcb-818c-8c73b2fda944 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state active and task_state resize_migrating.
Nov 02 05:14:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance destroyed successfully.
Nov 02 05:14:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1641266520-network", "vif_mac": "fa:16:3e:1e:6e:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1641266520-network", "vif_mac": "fa:16:3e:1e:6e:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_vif [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3432f410-eb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d046ad97-58ed-4aef-a0bc-3d38a19659b5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:14:59 user nova-compute[75216]: INFO os_vif [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb')
Nov 02 05:14:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:14:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6c5cc2-268c-4e4a-bb8e-fddc857e4ff9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:14:59 user nova-compute[75216]: No targets found.
Nov 02 05:14:59 user nova-compute[75216]: iSNS:
Nov 02 05:14:59 user nova-compute[75216]: No targets found.
Nov 02 05:14:59 user nova-compute[75216]: STATIC:
Nov 02 05:14:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:14:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:14:59 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:14:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:14:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:14:59 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:14:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808
Nov 02 05:14:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:14:59 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:14:59 user nova-compute[75216]: FIRMWARE:
Nov 02 05:14:59 user nova-compute[75216]: No targets found.
Nov 02 05:14:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:14:59 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:14:59 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f085aeb2-edb9-4ade-9a38-d49a160238b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263252e-ca85-493a-8982-d644a09dd525]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:59 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:59 user nova-compute[75216]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:14:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:14:59 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:14:59 user nova-compute[75216]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:14:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460c539990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[39197930-2a37-4575-8ce9-30ee73055f98]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0e8aeb-a161-4522-a43f-72a26a18929d]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9fe193-6284-4d98-b23f-9cd7fd5837e0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22571f98-dd64-475c-8c06-ac66966c1dfe]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2758546e-8bff-4554-848d-4412759af058]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb1684-a60e-44b5-9c6f-fc7711c6c5c3]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]
Nov 02 05:14:59 user nova-compute[75216]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.
Nov 02 05:14:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d36630-8112-46ca-be40-e531885d5576]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== disconnect_volume: return (353ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324_resize/disk /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "cp -r /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324_resize/disk /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk" returned: 0 in 0.343s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324_resize/disk.info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk.info {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "cp -r /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324_resize/disk.info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk.info" returned: 0 in 0.033s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-9338aa2c-d10f-4bc5-9e10-da7a5e5d07de req-6427eabe-b664-4c01-943f-ab0c164b5da6 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9338aa2c-d10f-4bc5-9e10-da7a5e5d07de req-6427eabe-b664-4c01-943f-ab0c164b5da6 service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9338aa2c-d10f-4bc5-9e10-da7a5e5d07de req-6427eabe-b664-4c01-943f-ab0c164b5da6 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9338aa2c-d10f-4bc5-9e10-da7a5e5d07de req-6427eabe-b664-4c01-943f-ab0c164b5da6 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-9338aa2c-d10f-4bc5-9e10-da7a5e5d07de req-6427eabe-b664-4c01-943f-ab0c164b5da6 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:15:01 user nova-compute[75216]: WARNING nova.compute.manager [req-9338aa2c-d10f-4bc5-9e10-da7a5e5d07de req-6427eabe-b664-4c01-943f-ab0c164b5da6 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state active and task_state resize_migrating.
Nov 02 05:15:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Port 3432f410-eb55-42af-83be-5c46c4ba340f binding to destination host user is already ACTIVE {{(pid=75216) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG os_brick.utils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64241c2a-f123-4adc-be70-faf3b9079ee2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c10fc-dae4-413e-9a08-170025f2dbd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc1505a-8078-417d-8d7a-561f7253efa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a7a0ee-194c-41a2-bbbf-77f5e22c2a52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:15:02 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:15:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a409013-3261-4098-b547-ee084d0e0672]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:15:02 user nova-compute[75216]: DEBUG os_brick.utils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:15:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Starting finish_migration {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 05:15:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Creating image(s)
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk. size=21474836480 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk 21474836480 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk 21474836480" returned: 0 in 0.044s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Ensure instance console log exists: /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Start _get_guest_xml network_info=[{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1641266520-network", "vif_mac": "fa:16:3e:1e:6e:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '76236690-58ea-462c-9ac7-84022116b99e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1ad38f2e-2d94-4437-b952-06bb0df47324', 'attached_at': '2023-11-02T05:15:21.000000', 'detached_at': '', 'volume_id': '58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'serial': '58054ab4-c4a9-4cdc-a14d-fc425fee249f'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:15:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:15:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:15:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:15:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:15:21 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f7738e-4268-4c40-8687-d86f79902db2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:15:21 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe67017-1eb3-4730-a4a0-59ac8f054877]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f] added
Nov 02 05:15:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deeaf90-532d-4ca9-8137-aa74f7509014]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99f707-fb39-4af2-b794-3bbf6486f514]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjyWniuh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjyWniuh" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[154a06dd-ca12-4a13-b8ef-f592438705da]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjyWniuh'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35c2a1-0942-46e9-bb8f-38d4339ae914]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c844d9df-bd01-45f3-930a-4eccb29202c1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:15:22 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:15:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:15:22 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:15:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b92430-8f3e-4485-b85a-9c7c9f93d505]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]
Nov 02 05:15:22 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.
Nov 02 05:15:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff8fc0-76dc-4712-bce7-83ddf84541bb]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0480df87-c81d-49da-b195-5726c070b93e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:15:22 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:15:22 user nova-compute[75216]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:15:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:15:22 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:15:22 user nova-compute[75216]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:15:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ebacc1-d552-43f4-946d-e30fbed0c421]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:15:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26261373564613535', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261373564613535', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1641266520-network", "vif_mac": "fa:16:3e:1e:6e:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1641266520-network", "vif_mac": "fa:16:3e:1e:6e:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:15:23 user nova-compute[75216]:   <uuid>1ad38f2e-2d94-4437-b952-06bb0df47324</uuid>
Nov 02 05:15:23 user nova-compute[75216]:   <name>instance-0000002d</name>
Nov 02 05:15:23 user nova-compute[75216]:   <memory>2097152</memory>
Nov 02 05:15:23 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:15:23 user nova-compute[75216]:   <metadata>
Nov 02 05:15:23 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:15:23 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:15:23 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherB-server-630037907</nova:name>
Nov 02 05:15:23 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:15:21</nova:creationTime>
Nov 02 05:15:23 user nova-compute[75216]:       <nova:flavor name="m1.small">
Nov 02 05:15:23 user nova-compute[75216]:         <nova:memory>2048</nova:memory>
Nov 02 05:15:23 user nova-compute[75216]:         <nova:disk>20</nova:disk>
Nov 02 05:15:23 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:15:23 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:15:23 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:15:23 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:15:23 user nova-compute[75216]:       <nova:owner>
Nov 02 05:15:23 user nova-compute[75216]:         <nova:user uuid="843262c7ee264eeeaefa636bb0b87566">tempest-ServerActionsTestOtherB-1123344217-project-member</nova:user>
Nov 02 05:15:23 user nova-compute[75216]:         <nova:project uuid="c8f6cf0694e14e73be222dfc12e2c4fa">tempest-ServerActionsTestOtherB-1123344217</nova:project>
Nov 02 05:15:23 user nova-compute[75216]:       </nova:owner>
Nov 02 05:15:23 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:15:23 user nova-compute[75216]:       <nova:ports>
Nov 02 05:15:23 user nova-compute[75216]:         <nova:port uuid="3432f410-eb55-42af-83be-5c46c4ba340f">
Nov 02 05:15:23 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 05:15:23 user nova-compute[75216]:         </nova:port>
Nov 02 05:15:23 user nova-compute[75216]:       </nova:ports>
Nov 02 05:15:23 user nova-compute[75216]:     </nova:instance>
Nov 02 05:15:23 user nova-compute[75216]:   </metadata>
Nov 02 05:15:23 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:15:23 user nova-compute[75216]:     <system>
Nov 02 05:15:23 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:15:23 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:15:23 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:15:23 user nova-compute[75216]:       <entry name="serial">1ad38f2e-2d94-4437-b952-06bb0df47324</entry>
Nov 02 05:15:23 user nova-compute[75216]:       <entry name="uuid">1ad38f2e-2d94-4437-b952-06bb0df47324</entry>
Nov 02 05:15:23 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:15:23 user nova-compute[75216]:     </system>
Nov 02 05:15:23 user nova-compute[75216]:   </sysinfo>
Nov 02 05:15:23 user nova-compute[75216]:   <os>
Nov 02 05:15:23 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:15:23 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:15:23 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:15:23 user nova-compute[75216]:   </os>
Nov 02 05:15:23 user nova-compute[75216]:   <features>
Nov 02 05:15:23 user nova-compute[75216]:     <acpi/>
Nov 02 05:15:23 user nova-compute[75216]:     <apic/>
Nov 02 05:15:23 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:15:23 user nova-compute[75216]:   </features>
Nov 02 05:15:23 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:15:23 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:15:23 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:15:23 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:15:23 user nova-compute[75216]:   </clock>
Nov 02 05:15:23 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:15:23 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:15:23 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:15:23 user nova-compute[75216]:   </cpu>
Nov 02 05:15:23 user nova-compute[75216]:   <devices>
Nov 02 05:15:23 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:15:23 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:15:23 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk"/>
Nov 02 05:15:23 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:15:23 user nova-compute[75216]:     </disk>
Nov 02 05:15:23 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:15:23 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:15:23 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 02 05:15:23 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 05:15:23 user nova-compute[75216]:       <serial>58054ab4-c4a9-4cdc-a14d-fc425fee249f</serial>
Nov 02 05:15:23 user nova-compute[75216]:     </disk>
Nov 02 05:15:23 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:15:23 user nova-compute[75216]:       <mac address="fa:16:3e:1e:6e:0b"/>
Nov 02 05:15:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:15:23 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:15:23 user nova-compute[75216]:       <target dev="tap3432f410-eb"/>
Nov 02 05:15:23 user nova-compute[75216]:     </interface>
Nov 02 05:15:23 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:15:23 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/console.log" append="off"/>
Nov 02 05:15:23 user nova-compute[75216]:     </serial>
Nov 02 05:15:23 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:15:23 user nova-compute[75216]:     <video>
Nov 02 05:15:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:15:23 user nova-compute[75216]:     </video>
Nov 02 05:15:23 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:15:23 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:15:23 user nova-compute[75216]:     </rng>
Nov 02 05:15:23 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:15:23 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:15:23 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:15:23 user nova-compute[75216]:     </memballoon>
Nov 02 05:15:23 user nova-compute[75216]:   </devices>
Nov 02 05:15:23 user nova-compute[75216]: </domain>
Nov 02 05:15:23 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1641266520-network", "vif_mac": "fa:16:3e:1e:6e:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1641266520-network", "vif_mac": "fa:16:3e:1e:6e:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG os_vif [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5240a7f9-b708-5e60-85b3-070bc9e2e4d8', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3432f410-eb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3432f410-eb, col_values=(('qos', UUID('8dc4c709-ea91-427b-8a1e-8cd06ce3be77')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3432f410-eb, col_values=(('external_ids', {'iface-id': '3432f410-eb55-42af-83be-5c46c4ba340f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:6e:0b', 'vm-uuid': '1ad38f2e-2d94-4437-b952-06bb0df47324'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:23 user nova-compute[75216]: INFO os_vif [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb')
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:15:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] No VIF found with MAC fa:16:3e:1e:6e:0b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-bd5eafe9-91d7-436f-b503-bd29f34be2ec req-ed98b130-8259-4fa8-9b92-94fa17693b08 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd5eafe9-91d7-436f-b503-bd29f34be2ec req-ed98b130-8259-4fa8-9b92-94fa17693b08 service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd5eafe9-91d7-436f-b503-bd29f34be2ec req-ed98b130-8259-4fa8-9b92-94fa17693b08 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd5eafe9-91d7-436f-b503-bd29f34be2ec req-ed98b130-8259-4fa8-9b92-94fa17693b08 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-bd5eafe9-91d7-436f-b503-bd29f34be2ec req-ed98b130-8259-4fa8-9b92-94fa17693b08 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:15:24 user nova-compute[75216]: WARNING nova.compute.manager [req-bd5eafe9-91d7-436f-b503-bd29f34be2ec req-ed98b130-8259-4fa8-9b92-94fa17693b08 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state active and task_state resize_finish.
Nov 02 05:15:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:15:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance running successfully.
Nov 02 05:15:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Failed to set time: agent not configured {{(pid=75216) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 05:15:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9c633f77-8a56-45c2-928b-e6408a683a13 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] finish_migration finished successfully. {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 05:15:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e74bcf9-d47d-4943-bb4f-004f88a85772 req-2425e6ca-20e6-464a-a2b2-1ebdb89d74aa service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:15:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e74bcf9-d47d-4943-bb4f-004f88a85772 req-2425e6ca-20e6-464a-a2b2-1ebdb89d74aa service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e74bcf9-d47d-4943-bb4f-004f88a85772 req-2425e6ca-20e6-464a-a2b2-1ebdb89d74aa service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e74bcf9-d47d-4943-bb4f-004f88a85772 req-2425e6ca-20e6-464a-a2b2-1ebdb89d74aa service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e74bcf9-d47d-4943-bb4f-004f88a85772 req-2425e6ca-20e6-464a-a2b2-1ebdb89d74aa service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:15:27 user nova-compute[75216]: WARNING nova.compute.manager [req-8e74bcf9-d47d-4943-bb4f-004f88a85772 req-2425e6ca-20e6-464a-a2b2-1ebdb89d74aa service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state active and task_state resize_finish.
Nov 02 05:15:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:15:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:15:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:15:30 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:15:30 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8346MB free_disk=24.847156524658203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Applying migration context for instance 1ad38f2e-2d94-4437-b952-06bb0df47324 as it has an incoming, in-progress migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9. Migration status is finished {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 05:15:30 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating resource usage from migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance ff449ddd-ef4d-4dcc-a32f-ba6445a74260 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:15:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:34 user nova-compute[75216]: INFO nova.compute.manager [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Terminating instance
Nov 02 05:15:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-703428f0-f8f2-4713-86c3-2060472952e8 req-be469bfd-16f0-4034-9ecf-058721522037 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-unplugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-703428f0-f8f2-4713-86c3-2060472952e8 req-be469bfd-16f0-4034-9ecf-058721522037 service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-703428f0-f8f2-4713-86c3-2060472952e8 req-be469bfd-16f0-4034-9ecf-058721522037 service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-703428f0-f8f2-4713-86c3-2060472952e8 req-be469bfd-16f0-4034-9ecf-058721522037 service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-703428f0-f8f2-4713-86c3-2060472952e8 req-be469bfd-16f0-4034-9ecf-058721522037 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-unplugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:15:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-703428f0-f8f2-4713-86c3-2060472952e8 req-be469bfd-16f0-4034-9ecf-058721522037 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-unplugged-854fad23-cb80-4a15-8cef-194613530198 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:15:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Instance destroyed successfully.
Nov 02 05:15:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'resources' on Instance uuid 399a6b48-bf68-4ae7-83e9-41e6014e8bfb {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-212758906',display_name='tempest-TestMinimumBasicScenario-server-212758906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-212758906',id=44,image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqz4YzavoU5vZ+Y+rciTjuVOWbnudtf9ADqs59JcpzXge9fKEI/9MeSiATWcnoxfaQCFqmXDNdhKl/Jt5bTp2Xa1Sojz6dbZqHUtyO+El9Vs2M0GFYDExX1F2FrSAhkdQ==',key_name='tempest-TestMinimumBasicScenario-200463085',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:10:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-vl3u51dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='416d7c1d-4f4f-4cd0-a7b8-a088bd661bcb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:12:49Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=399a6b48-bf68-4ae7-83e9-41e6014e8bfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "854fad23-cb80-4a15-8cef-194613530198", "address": "fa:16:3e:1f:18:40", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fad23-cb", "ovs_interfaceid": "854fad23-cb80-4a15-8cef-194613530198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG os_vif [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap854fad23-cb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fb54442-5021-4d5f-b0b9-d608e083daa3) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:35 user nova-compute[75216]: INFO os_vif [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:18:40,bridge_name='br-int',has_traffic_filtering=True,id=854fad23-cb80-4a15-8cef-194613530198,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fad23-cb')
Nov 02 05:15:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Deleting instance files /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb_del
Nov 02 05:15:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Deletion of /opt/stack/data/nova/instances/399a6b48-bf68-4ae7-83e9-41e6014e8bfb_del complete
Nov 02 05:15:35 user nova-compute[75216]: INFO nova.compute.manager [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 05:15:35 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:15:35 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Took 0.73 seconds to deallocate network for instance.
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-bfe9e2d5-f097-42ed-984e-a01821b6cea3 req-69593bb0-6e24-42ff-96fc-f0304a4962e7 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-deleted-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:15:35 user nova-compute[75216]: INFO nova.compute.manager [req-bfe9e2d5-f097-42ed-984e-a01821b6cea3 req-69593bb0-6e24-42ff-96fc-f0304a4962e7 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Neutron deleted interface 854fad23-cb80-4a15-8cef-194613530198; detaching it from the instance and deleting it from the info cache
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-bfe9e2d5-f097-42ed-984e-a01821b6cea3 req-69593bb0-6e24-42ff-96fc-f0304a4962e7 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-bfe9e2d5-f097-42ed-984e-a01821b6cea3 req-69593bb0-6e24-42ff-96fc-f0304a4962e7 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Detach interface failed, port_id=854fad23-cb80-4a15-8cef-194613530198, reason: Instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:36 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Deleted allocations for instance 399a6b48-bf68-4ae7-83e9-41e6014e8bfb
Nov 02 05:15:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ce670ee-99c9-4614-926d-62c2ff53721b tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-fd2637e7-3752-4fa0-bad9-c576cb372912 req-aaf18064-b4d2-41f9-b9df-cebe79e76c17 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fd2637e7-3752-4fa0-bad9-c576cb372912 req-aaf18064-b4d2-41f9-b9df-cebe79e76c17 service nova] Acquiring lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fd2637e7-3752-4fa0-bad9-c576cb372912 req-aaf18064-b4d2-41f9-b9df-cebe79e76c17 service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fd2637e7-3752-4fa0-bad9-c576cb372912 req-aaf18064-b4d2-41f9-b9df-cebe79e76c17 service nova] Lock "399a6b48-bf68-4ae7-83e9-41e6014e8bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:15:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-fd2637e7-3752-4fa0-bad9-c576cb372912 req-aaf18064-b4d2-41f9-b9df-cebe79e76c17 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] No waiting events found dispatching network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:15:36 user nova-compute[75216]: WARNING nova.compute.manager [req-fd2637e7-3752-4fa0-bad9-c576cb372912 req-aaf18064-b4d2-41f9-b9df-cebe79e76c17 service nova] [instance: 399a6b48-bf68-4ae7-83e9-41e6014e8bfb] Received unexpected event network-vif-plugged-854fad23-cb80-4a15-8cef-194613530198 for instance with vm_state deleted and task_state None.
Nov 02 05:15:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:15:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:15:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:15:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:15:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:15:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:15:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:15:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:15:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:15:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:16:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-changed-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Refreshing instance network info cache due to event network-changed-3e024723-b403-4472-b6ef-2208f683c89d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] Acquiring lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] Acquired lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Refreshing network info cache for port 3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updated VIF entry in instance network info cache for port 3e024723-b403-4472-b6ef-2208f683c89d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updating instance_info_cache with network_info: [{"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c3ca15ea-75d1-4c30-a0be-399077a94504 req-75ab391c-a51e-4d87-8810-dc212b8e6cef service nova] Releasing lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:21 user nova-compute[75216]: INFO nova.compute.manager [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Terminating instance
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-98180ee4-9312-4229-96b7-702930e7dc9e req-7b863956-9200-437c-a261-da9597e4763b service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-vif-unplugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98180ee4-9312-4229-96b7-702930e7dc9e req-7b863956-9200-437c-a261-da9597e4763b service nova] Acquiring lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98180ee4-9312-4229-96b7-702930e7dc9e req-7b863956-9200-437c-a261-da9597e4763b service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-98180ee4-9312-4229-96b7-702930e7dc9e req-7b863956-9200-437c-a261-da9597e4763b service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-98180ee4-9312-4229-96b7-702930e7dc9e req-7b863956-9200-437c-a261-da9597e4763b service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] No waiting events found dispatching network-vif-unplugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-98180ee4-9312-4229-96b7-702930e7dc9e req-7b863956-9200-437c-a261-da9597e4763b service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-vif-unplugged-3e024723-b403-4472-b6ef-2208f683c89d for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Instance destroyed successfully.
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'resources' on Instance uuid ff449ddd-ef4d-4dcc-a32f-ba6445a74260 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1028813084',display_name='tempest-TestVolumeBootPattern-server-1028813084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1028813084',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:14:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-pcnhrvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:14:56Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=ff449ddd-ef4d-4dcc-a32f-ba6445a74260,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1b:b1,bridge_name='br-int',has_traffic_filtering=True,id=3e024723-b403-4472-b6ef-2208f683c89d,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e024723-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_vif [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1b:b1,bridge_name='br-int',has_traffic_filtering=True,id=3e024723-b403-4472-b6ef-2208f683c89d,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e024723-b4') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e024723-b4, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a1e93fe-f0f7-426a-a029-2ed616aaa1ff) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:16:21 user nova-compute[75216]: INFO os_vif [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1b:b1,bridge_name='br-int',has_traffic_filtering=True,id=3e024723-b403-4472-b6ef-2208f683c89d,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e024723-b4')
Nov 02 05:16:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wENMmpgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:16:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16583eff-2301-4238-9ea3-1be88f2fbd0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:16:21 user nova-compute[75216]: No targets found.
Nov 02 05:16:21 user nova-compute[75216]: iSNS:
Nov 02 05:16:21 user nova-compute[75216]: No targets found.
Nov 02 05:16:21 user nova-compute[75216]: STATIC:
Nov 02 05:16:21 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:16:21 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:16:21 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:16:21 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:16:21 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:16:21 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:16:21 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808
Nov 02 05:16:21 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:16:21 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:16:21 user nova-compute[75216]: FIRMWARE:
Nov 02 05:16:21 user nova-compute[75216]: No targets found.
Nov 02 05:16:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:16:21 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:16:21 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[463aaefc-7d51-46a1-8dc2-d6a7a6a1d689]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfcdd8b-1dc0-4e7b-b637-95fba8209c38]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:16:21 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:16:21 user nova-compute[75216]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:16:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:16:21 user nova-compute[75216]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 (non-flash)
Nov 02 05:16:21 user nova-compute[75216]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:16:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46106d3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d3ddd-40c1-443c-8b50-bd676df3dbbf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d97610-b155-4f90-a7c6-b7fa47ee7f2b]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab34ac1-c37b-49dd-b408-4d408b29ff01]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd78e91a-a656-4832-8d83-d7bbcf821848]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23961613639333334', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_362ed956', '/dev/disk/by-id/scsi-1SCST_BIO362ed956-9aa6933423a720fe') {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ad6796-d4c1-4dfe-939b-477429015f40]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[853af0a6-32d5-40b8-b924-1214aa4cf1c2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:16:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa2f28-cf89-4bcc-8cba-d6f714073cf6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260]
Nov 02 05:16:22 user nova-compute[75216]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808, portal: 172.16.0.220,3260] successful.
Nov 02 05:16:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edcc57-e6b7-47e2-a739-59314a42d808 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.151s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3dc0d2-79cb-489e-86d8-d94423ed253d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== disconnect_volume: return (440ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:16:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Deleting instance files /opt/stack/data/nova/instances/ff449ddd-ef4d-4dcc-a32f-ba6445a74260_del
Nov 02 05:16:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Deletion of /opt/stack/data/nova/instances/ff449ddd-ef4d-4dcc-a32f-ba6445a74260_del complete
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-changed-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Refreshing instance network info cache due to event network-changed-3e024723-b403-4472-b6ef-2208f683c89d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] Acquiring lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] Acquired lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Refreshing network info cache for port 3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:16:22 user nova-compute[75216]: INFO nova.compute.manager [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updated VIF entry in instance network info cache for port 3e024723-b403-4472-b6ef-2208f683c89d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updating instance_info_cache with network_info: [{"id": "3e024723-b403-4472-b6ef-2208f683c89d", "address": "fa:16:3e:5f:1b:b1", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e024723-b4", "ovs_interfaceid": "3e024723-b403-4472-b6ef-2208f683c89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aaeb1d7a-51a8-4ea7-9a12-f0da33dbddf4 req-5ad81616-9f63-41f3-a332-cd388d5ef3f1 service nova] Releasing lock "refresh_cache-ff449ddd-ef4d-4dcc-a32f-ba6445a74260" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:23 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Took 1.03 seconds to deallocate network for instance.
Nov 02 05:16:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-49679a79-6d4b-4fdd-82de-3ab70ed06ad5 req-273516e7-71b4-48a2-bd2f-868afe4cd8b3 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-vif-deleted-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:23 user nova-compute[75216]: INFO nova.compute.manager [req-49679a79-6d4b-4fdd-82de-3ab70ed06ad5 req-273516e7-71b4-48a2-bd2f-868afe4cd8b3 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Neutron deleted interface 3e024723-b403-4472-b6ef-2208f683c89d; detaching it from the instance and deleting it from the info cache
Nov 02 05:16:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-49679a79-6d4b-4fdd-82de-3ab70ed06ad5 req-273516e7-71b4-48a2-bd2f-868afe4cd8b3 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-49679a79-6d4b-4fdd-82de-3ab70ed06ad5 req-273516e7-71b4-48a2-bd2f-868afe4cd8b3 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Detach interface failed, port_id=3e024723-b403-4472-b6ef-2208f683c89d, reason: Instance ff449ddd-ef4d-4dcc-a32f-ba6445a74260 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 05:16:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-f762c5f5-45ea-4240-8a6b-c1948c0f097e req-a02bf75b-61c7-4e4a-b11b-3a89c9247447 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received event network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f762c5f5-45ea-4240-8a6b-c1948c0f097e req-a02bf75b-61c7-4e4a-b11b-3a89c9247447 service nova] Acquiring lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f762c5f5-45ea-4240-8a6b-c1948c0f097e req-a02bf75b-61c7-4e4a-b11b-3a89c9247447 service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f762c5f5-45ea-4240-8a6b-c1948c0f097e req-a02bf75b-61c7-4e4a-b11b-3a89c9247447 service nova] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-f762c5f5-45ea-4240-8a6b-c1948c0f097e req-a02bf75b-61c7-4e4a-b11b-3a89c9247447 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] No waiting events found dispatching network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:16:23 user nova-compute[75216]: WARNING nova.compute.manager [req-f762c5f5-45ea-4240-8a6b-c1948c0f097e req-a02bf75b-61c7-4e4a-b11b-3a89c9247447 service nova] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Received unexpected event network-vif-plugged-3e024723-b403-4472-b6ef-2208f683c89d for instance with vm_state active and task_state deleting.
Nov 02 05:16:24 user nova-compute[75216]: INFO nova.compute.manager [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: ff449ddd-ef4d-4dcc-a32f-ba6445a74260] Took 0.89 seconds to detach 1 volumes for instance.
Nov 02 05:16:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:16:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:16:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:24 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Deleted allocations for instance ff449ddd-ef4d-4dcc-a32f-ba6445a74260
Nov 02 05:16:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f7c65e38-d7f0-4c5f-bcaf-5e6be35af9d1 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "ff449ddd-ef4d-4dcc-a32f-ba6445a74260" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.664s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:16:28 user nova-compute[75216]: INFO nova.compute.claims [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Claim successful on node user
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:16:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:16:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:16:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:16:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=24.892154693603516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:16:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Applying migration context for instance 1ad38f2e-2d94-4437-b952-06bb0df47324 as it has an incoming, in-progress migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9. Migration status is finished {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 05:16:29 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating resource usage from migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.policy [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a60b807f9454e49917d372178cc196f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bbd2a0fea340eda045059153a3ed9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:16:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Creating image(s)
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "/opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "/opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "c13353c3fb29102a5a55a3ad8aca40d4b769e04a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "c13353c3fb29102a5a55a3ad8aca40d4b769e04a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Successfully created port: 057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.936s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.virt.images [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] 24d566e6-665e-4043-a961-22aeab2482de was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 05:16:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.part /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.part /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.converted" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "c13353c3fb29102a5a55a3ad8aca40d4b769e04a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.050s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Successfully updated port: 057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing instance network info cache due to event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "c13353c3fb29102a5a55a3ad8aca40d4b769e04a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "c13353c3fb29102a5a55a3ad8aca40d4b769e04a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a,backing_fmt=raw /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a,backing_fmt=raw /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk 1073741824" returned: 0 in 0.055s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "c13353c3fb29102a5a55a3ad8aca40d4b769e04a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance network_info: |[{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:16:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Cannot resize image /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Ensure instance console log exists: /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Start _get_guest_xml network_info=[{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T05:16:26Z,direct_url=<?>,disk_format='qcow2',id=24d566e6-665e-4043-a961-22aeab2482de,min_disk=0,min_ram=0,name='tempest-scenario-img--1804179674',owner='e0bbd2a0fea340eda045059153a3ed9f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T05:16:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '24d566e6-665e-4043-a961-22aeab2482de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:16:32 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:16:32 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T05:16:26Z,direct_url=<?>,disk_format='qcow2',id=24d566e6-665e-4043-a961-22aeab2482de,min_disk=0,min_ram=0,name='tempest-scenario-img--1804179674',owner='e0bbd2a0fea340eda045059153a3ed9f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T05:16:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432773736',display_name='tempest-TestMinimumBasicScenario-server-1432773736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432773736',id=49,image_ref='24d566e6-665e-4043-a961-22aeab2482de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0BJKcLkwB2uxIrYja6jr96tA0vCcxDANWFNDiSj95ghdSmZgayVU6nSABdFb8zsZzYSClOsAvbi8CKPFvIECsZh2VXJyxj7mE1VKsvWGEbC8E2keFtSp9K2pSc00srog==',key_name='tempest-TestMinimumBasicScenario-1282687824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-9rkaaet7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24d566e6-665e-4043-a961-22aeab2482de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:16:30Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=4f7dea1b-7916-4d4e-b0c2-d4e111513f21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:68:80,bridge_name='br-int',has_traffic_filtering=True,id=057fe2b6-edae-428a-af80-4dc3475118c6,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057fe2b6-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:16:32 user nova-compute[75216]:   <uuid>4f7dea1b-7916-4d4e-b0c2-d4e111513f21</uuid>
Nov 02 05:16:32 user nova-compute[75216]:   <name>instance-00000031</name>
Nov 02 05:16:32 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:16:32 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:16:32 user nova-compute[75216]:   <metadata>
Nov 02 05:16:32 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:16:32 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:16:32 user nova-compute[75216]:       <nova:name>tempest-TestMinimumBasicScenario-server-1432773736</nova:name>
Nov 02 05:16:32 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:16:32</nova:creationTime>
Nov 02 05:16:32 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:16:32 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:16:32 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:16:32 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:16:32 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:16:32 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:16:32 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:16:32 user nova-compute[75216]:       <nova:owner>
Nov 02 05:16:32 user nova-compute[75216]:         <nova:user uuid="8a60b807f9454e49917d372178cc196f">tempest-TestMinimumBasicScenario-1935471528-project-member</nova:user>
Nov 02 05:16:32 user nova-compute[75216]:         <nova:project uuid="e0bbd2a0fea340eda045059153a3ed9f">tempest-TestMinimumBasicScenario-1935471528</nova:project>
Nov 02 05:16:32 user nova-compute[75216]:       </nova:owner>
Nov 02 05:16:32 user nova-compute[75216]:       <nova:root type="image" uuid="24d566e6-665e-4043-a961-22aeab2482de"/>
Nov 02 05:16:32 user nova-compute[75216]:       <nova:ports>
Nov 02 05:16:32 user nova-compute[75216]:         <nova:port uuid="057fe2b6-edae-428a-af80-4dc3475118c6">
Nov 02 05:16:32 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 05:16:32 user nova-compute[75216]:         </nova:port>
Nov 02 05:16:32 user nova-compute[75216]:       </nova:ports>
Nov 02 05:16:32 user nova-compute[75216]:     </nova:instance>
Nov 02 05:16:32 user nova-compute[75216]:   </metadata>
Nov 02 05:16:32 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:16:32 user nova-compute[75216]:     <system>
Nov 02 05:16:32 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:16:32 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:16:32 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:16:32 user nova-compute[75216]:       <entry name="serial">4f7dea1b-7916-4d4e-b0c2-d4e111513f21</entry>
Nov 02 05:16:32 user nova-compute[75216]:       <entry name="uuid">4f7dea1b-7916-4d4e-b0c2-d4e111513f21</entry>
Nov 02 05:16:32 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:16:32 user nova-compute[75216]:     </system>
Nov 02 05:16:32 user nova-compute[75216]:   </sysinfo>
Nov 02 05:16:32 user nova-compute[75216]:   <os>
Nov 02 05:16:32 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:16:32 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:16:32 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:16:32 user nova-compute[75216]:   </os>
Nov 02 05:16:32 user nova-compute[75216]:   <features>
Nov 02 05:16:32 user nova-compute[75216]:     <acpi/>
Nov 02 05:16:32 user nova-compute[75216]:     <apic/>
Nov 02 05:16:32 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:16:32 user nova-compute[75216]:   </features>
Nov 02 05:16:32 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:16:32 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:16:32 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:16:32 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:16:32 user nova-compute[75216]:   </clock>
Nov 02 05:16:32 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:16:32 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:16:32 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:16:32 user nova-compute[75216]:   </cpu>
Nov 02 05:16:32 user nova-compute[75216]:   <devices>
Nov 02 05:16:32 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:16:32 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:16:32 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk"/>
Nov 02 05:16:32 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:16:32 user nova-compute[75216]:     </disk>
Nov 02 05:16:32 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:16:32 user nova-compute[75216]:       <mac address="fa:16:3e:7f:68:80"/>
Nov 02 05:16:32 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:16:32 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:16:32 user nova-compute[75216]:       <target dev="tap057fe2b6-ed"/>
Nov 02 05:16:32 user nova-compute[75216]:     </interface>
Nov 02 05:16:32 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:16:32 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/console.log" append="off"/>
Nov 02 05:16:32 user nova-compute[75216]:     </serial>
Nov 02 05:16:32 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:16:32 user nova-compute[75216]:     <video>
Nov 02 05:16:32 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:16:32 user nova-compute[75216]:     </video>
Nov 02 05:16:32 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:16:32 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:16:32 user nova-compute[75216]:     </rng>
Nov 02 05:16:32 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:16:32 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:16:32 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:16:32 user nova-compute[75216]:     </memballoon>
Nov 02 05:16:32 user nova-compute[75216]:   </devices>
Nov 02 05:16:32 user nova-compute[75216]: </domain>
Nov 02 05:16:32 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432773736',display_name='tempest-TestMinimumBasicScenario-server-1432773736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432773736',id=49,image_ref='24d566e6-665e-4043-a961-22aeab2482de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0BJKcLkwB2uxIrYja6jr96tA0vCcxDANWFNDiSj95ghdSmZgayVU6nSABdFb8zsZzYSClOsAvbi8CKPFvIECsZh2VXJyxj7mE1VKsvWGEbC8E2keFtSp9K2pSc00srog==',key_name='tempest-TestMinimumBasicScenario-1282687824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-9rkaaet7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24d566e6-665e-4043-a961-22aeab2482de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:16:30Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=4f7dea1b-7916-4d4e-b0c2-d4e111513f21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:68:80,bridge_name='br-int',has_traffic_filtering=True,id=057fe2b6-edae-428a-af80-4dc3475118c6,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057fe2b6-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG os_vif [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:68:80,bridge_name='br-int',has_traffic_filtering=True,id=057fe2b6-edae-428a-af80-4dc3475118c6,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057fe2b6-ed') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '582091c3-651e-54fc-8f90-bd9a2796e1ed', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap057fe2b6-ed, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap057fe2b6-ed, col_values=(('qos', UUID('d32449f0-ba1e-4af7-98ed-1cdd2f63a609')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap057fe2b6-ed, col_values=(('external_ids', {'iface-id': '057fe2b6-edae-428a-af80-4dc3475118c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:68:80', 'vm-uuid': '4f7dea1b-7916-4d4e-b0c2-d4e111513f21'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:32 user nova-compute[75216]: INFO os_vif [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:68:80,bridge_name='br-int',has_traffic_filtering=True,id=057fe2b6-edae-428a-af80-4dc3475118c6,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057fe2b6-ed')
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No VIF found with MAC fa:16:3e:7f:68:80, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updated VIF entry in instance network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43fdcacf-b8f2-4c9e-a158-ca58e4a6b7df req-6200d6c4-ac27-48d2-b281-fdcfa0e85e00 service nova] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-changed-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Refreshing instance network info cache due to event network-changed-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] Acquiring lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] Acquired lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:32 user nova-compute[75216]: DEBUG nova.network.neutron [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Refreshing network info cache for port e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updated VIF entry in instance network info cache for port e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating instance_info_cache with network_info: [{"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca62268-9305-4448-b85a-5136de5daf4d req-2a1db3b9-8eeb-4d8f-a10b-61e144082dfc service nova] Releasing lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:16:34 user nova-compute[75216]: WARNING nova.compute.manager [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state building and task_state spawning.
Nov 02 05:16:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:16:34 user nova-compute[75216]: WARNING nova.compute.manager [req-a96942a7-6088-461b-910f-69cf51146bb1 req-364259a4-4b90-4c84-ad6d-64d7ee996dce service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state building and task_state spawning.
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:16:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance spawned successfully.
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:16:35 user nova-compute[75216]: INFO nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 02 05:16:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:16:36 user nova-compute[75216]: INFO nova.compute.manager [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Took 7.12 seconds to build instance.
Nov 02 05:16:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-99e6024e-c68f-4cff-8fac-b43aa509bf19 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.240s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:39 user nova-compute[75216]: INFO nova.compute.manager [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attaching volume 1281a33a-5e81-4fd8-a489-4911e032782f to /dev/vdb
Nov 02 05:16:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9df835-3a3d-4f69-9775-2f5b96be4b6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec933f8-9d46-4ac6-a3ce-d7c9f6ae6085]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b1896-a297-47e4-8af3-d189993363eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4a83a-f7a2-4a47-ba63-9ddde34b28b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:16:39 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:16:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091bd73-f331-427b-8c64-2114285b988d]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating existing volume attachment record: 8cddb4bd-eebb-4957-a2d4-b6621244cc28 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:16:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updating instance_info_cache with network_info: [{"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Port 3432f410-eb55-42af-83be-5c46c4ba340f binding to destination host user is already ACTIVE {{(pid=75216) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Creating tmpfile /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/tmpfe2gi1f4 to verify with other compute node that the instance is on the same shared storage. {{(pid=75216) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-11cda0f4-f727-4b07-809b-3ae1b9592404 req-17457c41-9e58-4bed-bf0d-91ba8470661f service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11cda0f4-f727-4b07-809b-3ae1b9592404 req-17457c41-9e58-4bed-bf0d-91ba8470661f service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11cda0f4-f727-4b07-809b-3ae1b9592404 req-17457c41-9e58-4bed-bf0d-91ba8470661f service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11cda0f4-f727-4b07-809b-3ae1b9592404 req-17457c41-9e58-4bed-bf0d-91ba8470661f service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-11cda0f4-f727-4b07-809b-3ae1b9592404 req-17457c41-9e58-4bed-bf0d-91ba8470661f service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:16:48 user nova-compute[75216]: WARNING nova.compute.manager [req-11cda0f4-f727-4b07-809b-3ae1b9592404 req-17457c41-9e58-4bed-bf0d-91ba8470661f service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state resized and task_state resize_reverting.
Nov 02 05:16:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance destroyed successfully.
Nov 02 05:16:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lazy-loading 'resources' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_vif [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3432f410-eb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dc4c709-ea91-427b-8a1e-8cd06ce3be77) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:49 user nova-compute[75216]: INFO os_vif [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb')
Nov 02 05:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:16:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2db5d3-74b1-4632-8e48-98f41b5fc3f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:16:49 user nova-compute[75216]: No targets found.
Nov 02 05:16:49 user nova-compute[75216]: iSNS:
Nov 02 05:16:49 user nova-compute[75216]: No targets found.
Nov 02 05:16:49 user nova-compute[75216]: STATIC:
Nov 02 05:16:49 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:16:49 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:16:49 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:16:49 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:16:49 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:16:49 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:16:49 user nova-compute[75216]: FIRMWARE:
Nov 02 05:16:49 user nova-compute[75216]: No targets found.
Nov 02 05:16:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:16:49 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:16:49 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed269b4-ac03-49e2-afe2-f59fb1b421f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75115bc-4061-4156-895e-97f961857228]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:16:49 user nova-compute[75216]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:16:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:16:49 user nova-compute[75216]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:16:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec2a6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d74ce0d-fdb3-478b-b1ca-39fdc201657f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a2ae5-6c69-4f0e-98dc-21c4fd9460a1]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c383537b-3cfd-4d9e-85dc-52335cbbbdc5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b7bba5-7052-4d01-8264-972c9f6bfbd2]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4223b-4652-4ef4-831f-ae67f6f8f60a]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f775c7-9405-4ed4-ab59-f3287775e161]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]
Nov 02 05:16:49 user nova-compute[75216]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.
Nov 02 05:16:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e1a76-a06a-4057-ad7f-3410f33f9535]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== disconnect_volume: return (314ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lazy-loading 'migration_context' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG nova.objects.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Object Instance<1ad38f2e-2d94-4437-b952-06bb0df47324> lazy-loaded attributes: resources,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-8eb0ba62-df69-4d10-8d6e-7a7fdf99aaf0 req-577d26f1-ad51-4e30-b0fc-4c80ea7b43e2 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8eb0ba62-df69-4d10-8d6e-7a7fdf99aaf0 req-577d26f1-ad51-4e30-b0fc-4c80ea7b43e2 service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8eb0ba62-df69-4d10-8d6e-7a7fdf99aaf0 req-577d26f1-ad51-4e30-b0fc-4c80ea7b43e2 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8eb0ba62-df69-4d10-8d6e-7a7fdf99aaf0 req-577d26f1-ad51-4e30-b0fc-4c80ea7b43e2 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-8eb0ba62-df69-4d10-8d6e-7a7fdf99aaf0 req-577d26f1-ad51-4e30-b0fc-4c80ea7b43e2 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:16:50 user nova-compute[75216]: WARNING nova.compute.manager [req-8eb0ba62-df69-4d10-8d6e-7a7fdf99aaf0 req-577d26f1-ad51-4e30-b0fc-4c80ea7b43e2 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state resized and task_state resize_reverting.
Nov 02 05:16:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.330s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:16:51 user nova-compute[75216]: INFO nova.compute.manager [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Swapping old allocation on dict_keys(['d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3']) held by migration f0ddcc1f-addf-47da-8eab-ebe7c880f3e9 for instance
Nov 02 05:16:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Overwriting current allocation {'allocations': {'d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 59}}, 'project_id': 'c8f6cf0694e14e73be222dfc12e2c4fa', 'user_id': '843262c7ee264eeeaefa636bb0b87566', 'consumer_generation': 1} on consumer 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4800c999-37df-4279-8609-dad9b55250f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b229b8-605d-49ee-b22f-900e2bd681d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae16068-e645-4f2a-a281-079c8c663559]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa85b36-2eed-452d-8a7b-69c74d1bd739]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:16:52 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:16:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c70320-2e02-42ee-b565-956e1fa25a7f]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:16:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:16:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhNlYKpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:17:03 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:17:03 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:17:03 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3519f-2513-47a0-8589-0bd2a9a4cb4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:17:03 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f7124-351b-4c06-b461-969fe8245fa1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f] added
Nov 02 05:17:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2058744-3180-4d8f-bc9b-861fbda86021]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da0905-039f-4df4-8def-f69c584ee9fc]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhNlYKpd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhNlYKpd" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbce632f-b141-4f32-9e4f-67f0bb23e214]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GhNlYKpd'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db65b39d-c147-4345-9960-cb542a7d5c69]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad73c7e-9c3c-485f-8c72-fefec2967077]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c7f85-c5b4-456a-840f-c806cd2cc8bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260]
Nov 02 05:17:03 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260] successful.
Nov 02 05:17:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd9c4a6-77aa-49c0-a492-ef69f535f652]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b681ca50-c227-41be-919e-efd99ea6ec1f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:03 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:03 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3614f1-38f3-4acf-8055-1143d17a1ff5]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:17:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhNlYKpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:17:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:17:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23935303364333164', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:17:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935303364333164', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:17:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:17:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:17:04 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:17:04 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:17:04 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:17:04 user nova-compute[75216]:   <serial>1281a33a-5e81-4fd8-a489-4911e032782f</serial>
Nov 02 05:17:04 user nova-compute[75216]: </disk>
Nov 02 05:17:04 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:17:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:17:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:17:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No VIF found with MAC fa:16:3e:e1:57:3b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:17:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa22b966-b6aa-4c62-a302-2c16d6085bb3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.755s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Starting finish_revert_migration {{(pid=75216) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Start _get_guest_xml network_info=[{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '35692f7d-c493-490b-81f0-181df3487aa8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1ad38f2e-2d94-4437-b952-06bb0df47324', 'attached_at': '2023-11-02T05:17:11.000000', 'detached_at': '', 'volume_id': '58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'serial': '58054ab4-c4a9-4cdc-a14d-fc425fee249f'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:17:11 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:17:11 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:17:11 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:17:11 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:17:11 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c364659e-ef1a-43d9-8df5-31cf44c5c07d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:17:11 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f6248-ce5c-4379-87fb-e538b1693761]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f] added
Nov 02 05:17:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1c88ce-3a44-45de-97c2-6e4992808eff]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f92cee-5743-450b-a11d-680e7e51503f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjyWniuh {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjyWniuh" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f292163-65c7-405b-9918-b9a424269b6e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjyWniuh'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed283e-ab0c-4daa-9ee1-fc92a046907d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42db1bf-b336-467f-9255-fb04fa640eb1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:11 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:11 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b4e8fc-09bf-4f4f-9def-41d4daa17f99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]
Nov 02 05:17:11 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.
Nov 02 05:17:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f26066-51ca-4530-b699-47ddca011b5f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d683675f-411b-4066-bc2f-d9ccfed21540]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:11 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:11 user nova-compute[75216]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:17:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:11 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:11 user nova-compute[75216]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:17:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[320d9f98-237f-4809-9284-8dfd298e11ce]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:17:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26261373564613535', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261373564613535', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:17:12 user nova-compute[75216]:   <uuid>1ad38f2e-2d94-4437-b952-06bb0df47324</uuid>
Nov 02 05:17:12 user nova-compute[75216]:   <name>instance-0000002d</name>
Nov 02 05:17:12 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:17:12 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:17:12 user nova-compute[75216]:   <metadata>
Nov 02 05:17:12 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:17:12 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:17:12 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherB-server-630037907</nova:name>
Nov 02 05:17:12 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:17:11</nova:creationTime>
Nov 02 05:17:12 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:17:12 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:17:12 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:17:12 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:17:12 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:17:12 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:17:12 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:17:12 user nova-compute[75216]:       <nova:owner>
Nov 02 05:17:12 user nova-compute[75216]:         <nova:user uuid="843262c7ee264eeeaefa636bb0b87566">tempest-ServerActionsTestOtherB-1123344217-project-member</nova:user>
Nov 02 05:17:12 user nova-compute[75216]:         <nova:project uuid="c8f6cf0694e14e73be222dfc12e2c4fa">tempest-ServerActionsTestOtherB-1123344217</nova:project>
Nov 02 05:17:12 user nova-compute[75216]:       </nova:owner>
Nov 02 05:17:12 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:17:12 user nova-compute[75216]:       <nova:ports>
Nov 02 05:17:12 user nova-compute[75216]:         <nova:port uuid="3432f410-eb55-42af-83be-5c46c4ba340f">
Nov 02 05:17:12 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 05:17:12 user nova-compute[75216]:         </nova:port>
Nov 02 05:17:12 user nova-compute[75216]:       </nova:ports>
Nov 02 05:17:12 user nova-compute[75216]:     </nova:instance>
Nov 02 05:17:12 user nova-compute[75216]:   </metadata>
Nov 02 05:17:12 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:17:12 user nova-compute[75216]:     <system>
Nov 02 05:17:12 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:17:12 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:17:12 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:17:12 user nova-compute[75216]:       <entry name="serial">1ad38f2e-2d94-4437-b952-06bb0df47324</entry>
Nov 02 05:17:12 user nova-compute[75216]:       <entry name="uuid">1ad38f2e-2d94-4437-b952-06bb0df47324</entry>
Nov 02 05:17:12 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:17:12 user nova-compute[75216]:     </system>
Nov 02 05:17:12 user nova-compute[75216]:   </sysinfo>
Nov 02 05:17:12 user nova-compute[75216]:   <os>
Nov 02 05:17:12 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:17:12 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:17:12 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:17:12 user nova-compute[75216]:   </os>
Nov 02 05:17:12 user nova-compute[75216]:   <features>
Nov 02 05:17:12 user nova-compute[75216]:     <acpi/>
Nov 02 05:17:12 user nova-compute[75216]:     <apic/>
Nov 02 05:17:12 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:17:12 user nova-compute[75216]:   </features>
Nov 02 05:17:12 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:17:12 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:17:12 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:17:12 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:17:12 user nova-compute[75216]:   </clock>
Nov 02 05:17:12 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:17:12 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:17:12 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:17:12 user nova-compute[75216]:   </cpu>
Nov 02 05:17:12 user nova-compute[75216]:   <devices>
Nov 02 05:17:12 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:17:12 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:17:12 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk"/>
Nov 02 05:17:12 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:17:12 user nova-compute[75216]:     </disk>
Nov 02 05:17:12 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 02 05:17:12 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:17:12 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 02 05:17:12 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 05:17:12 user nova-compute[75216]:       <serial>58054ab4-c4a9-4cdc-a14d-fc425fee249f</serial>
Nov 02 05:17:12 user nova-compute[75216]:     </disk>
Nov 02 05:17:12 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:17:12 user nova-compute[75216]:       <mac address="fa:16:3e:1e:6e:0b"/>
Nov 02 05:17:12 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:17:12 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:17:12 user nova-compute[75216]:       <target dev="tap3432f410-eb"/>
Nov 02 05:17:12 user nova-compute[75216]:     </interface>
Nov 02 05:17:12 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:17:12 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/console.log" append="off"/>
Nov 02 05:17:12 user nova-compute[75216]:     </serial>
Nov 02 05:17:12 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:17:12 user nova-compute[75216]:     <video>
Nov 02 05:17:12 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:17:12 user nova-compute[75216]:     </video>
Nov 02 05:17:12 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:17:12 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:17:12 user nova-compute[75216]:     </rng>
Nov 02 05:17:12 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:17:12 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:17:12 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:17:12 user nova-compute[75216]:     </memballoon>
Nov 02 05:17:12 user nova-compute[75216]:   </devices>
Nov 02 05:17:12 user nova-compute[75216]: </domain>
Nov 02 05:17:12 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG os_vif [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5240a7f9-b708-5e60-85b3-070bc9e2e4d8', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3432f410-eb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3432f410-eb, col_values=(('qos', UUID('599de9d4-0402-4c0a-a0f6-cff4b5e8fd39')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3432f410-eb, col_values=(('external_ids', {'iface-id': '3432f410-eb55-42af-83be-5c46c4ba340f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:6e:0b', 'vm-uuid': '1ad38f2e-2d94-4437-b952-06bb0df47324'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:12 user nova-compute[75216]: INFO os_vif [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb')
Nov 02 05:17:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-d7492099-122c-405d-8a91-c4c65201d2f5 req-19ecdbbe-00a5-4d5d-9ce3-e0881a88f81e service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:17:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7492099-122c-405d-8a91-c4c65201d2f5 req-19ecdbbe-00a5-4d5d-9ce3-e0881a88f81e service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7492099-122c-405d-8a91-c4c65201d2f5 req-19ecdbbe-00a5-4d5d-9ce3-e0881a88f81e service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d7492099-122c-405d-8a91-c4c65201d2f5 req-19ecdbbe-00a5-4d5d-9ce3-e0881a88f81e service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-d7492099-122c-405d-8a91-c4c65201d2f5 req-19ecdbbe-00a5-4d5d-9ce3-e0881a88f81e service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:17:14 user nova-compute[75216]: WARNING nova.compute.manager [req-d7492099-122c-405d-8a91-c4c65201d2f5 req-19ecdbbe-00a5-4d5d-9ce3-e0881a88f81e service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state resized and task_state resize_reverting.
Nov 02 05:17:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:17:16 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance running successfully.
Nov 02 05:17:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] finish_revert_migration finished successfully. {{(pid=75216) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 02 05:17:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-db5d62d0-37be-49fc-b5b0-7270852e2b35 req-fd1ddedc-39e9-4b09-b4cf-fa59e56f9ea5 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:17:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db5d62d0-37be-49fc-b5b0-7270852e2b35 req-fd1ddedc-39e9-4b09-b4cf-fa59e56f9ea5 service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db5d62d0-37be-49fc-b5b0-7270852e2b35 req-fd1ddedc-39e9-4b09-b4cf-fa59e56f9ea5 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-db5d62d0-37be-49fc-b5b0-7270852e2b35 req-fd1ddedc-39e9-4b09-b4cf-fa59e56f9ea5 service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-db5d62d0-37be-49fc-b5b0-7270852e2b35 req-fd1ddedc-39e9-4b09-b4cf-fa59e56f9ea5 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:17:16 user nova-compute[75216]: WARNING nova.compute.manager [req-db5d62d0-37be-49fc-b5b0-7270852e2b35 req-fd1ddedc-39e9-4b09-b4cf-fa59e56f9ea5 service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state resized and task_state resize_reverting.
Nov 02 05:17:16 user nova-compute[75216]: INFO nova.compute.manager [None req-df82cdad-e3a2-4c77-b781-f229653b15d5 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance to original state: 'active'
Nov 02 05:17:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:17:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:17:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:17:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8300MB free_disk=24.839534759521484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:17:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-changed-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Refreshing instance network info cache due to event network-changed-54e3673a-84ab-42ed-b84c-56454ab166bf. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] Acquiring lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] Acquired lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Refreshing network info cache for port 54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:34 user nova-compute[75216]: INFO nova.compute.manager [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Terminating instance
Nov 02 05:17:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updated VIF entry in instance network info cache for port 54e3673a-84ab-42ed-b84c-56454ab166bf. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updating instance_info_cache with network_info: [{"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d751550e-ab11-4c3e-b7e5-9abb476b0a6e req-c03ac00a-d9fe-46d2-bfe4-f81b5beb5eda service nova] Releasing lock "refresh_cache-6bb2def8-34e6-4b4c-ab60-86f17a9a8567" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Instance destroyed successfully.
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lazy-loading 'resources' on Instance uuid 6bb2def8-34e6-4b4c-ab60-86f17a9a8567 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1644282453',display_name='tempest-TestVolumeBootPattern-server-1644282453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1644282453',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGquJiEHdrl8ozQQWBmClv3iwRbVF25dwvqdOmX+CRY1jATHHQBCaUqOaprNCy8N2GUPuKWOB4ivX0g7wQum/d1Azo8f0ONBlzOplEsIkgfT9Ztv0noyNqiOp/Aaw4VOQ==',key_name='tempest-TestVolumeBootPattern-577017087',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eeaefe9a0e4468d9bbb99ba3aca7c64',ramdisk_id='',reservation_id='r-k5ibgbms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-773799094',owner_user_name='tempest-TestVolumeBootPattern-773799094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:12:45Z,user_data=None,user_id='94f0b01ce0c744bdbb937e0a477dcf07',uuid=6bb2def8-34e6-4b4c-ab60-86f17a9a8567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converting VIF {"id": "54e3673a-84ab-42ed-b84c-56454ab166bf", "address": "fa:16:3e:17:e4:ca", "network": {"id": "7f693764-ad1b-40ab-ac6b-c9891ca519de", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-27531011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eeaefe9a0e4468d9bbb99ba3aca7c64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54e3673a-84", "ovs_interfaceid": "54e3673a-84ab-42ed-b84c-56454ab166bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:e4:ca,bridge_name='br-int',has_traffic_filtering=True,id=54e3673a-84ab-42ed-b84c-56454ab166bf,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54e3673a-84') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_vif [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e4:ca,bridge_name='br-int',has_traffic_filtering=True,id=54e3673a-84ab-42ed-b84c-56454ab166bf,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54e3673a-84') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54e3673a-84, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f10d71ab-c6d0-43cc-9380-840911095ad8) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:35 user nova-compute[75216]: INFO os_vif [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e4:ca,bridge_name='br-int',has_traffic_filtering=True,id=54e3673a-84ab-42ed-b84c-56454ab166bf,network=Network(7f693764-ad1b-40ab-ac6b-c9891ca519de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54e3673a-84')
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFvxXPCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:17:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af063c10-5b12-4da1-b164-ecc367970401]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:17:35 user nova-compute[75216]: No targets found.
Nov 02 05:17:35 user nova-compute[75216]: iSNS:
Nov 02 05:17:35 user nova-compute[75216]: No targets found.
Nov 02 05:17:35 user nova-compute[75216]: STATIC:
Nov 02 05:17:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f
Nov 02 05:17:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:17:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:17:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a
Nov 02 05:17:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:17:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:17:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:17:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:17:35 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:17:35 user nova-compute[75216]: FIRMWARE:
Nov 02 05:17:35 user nova-compute[75216]: No targets found.
Nov 02 05:17:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:17:35 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:17:35 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c2842-7d8a-4ea0-9b77-096dd89600ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14d971-2c26-4401-a025-776d62241c86]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:35 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:35 user nova-compute[75216]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:17:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a (non-flash)
Nov 02 05:17:35 user nova-compute[75216]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:17:35 user nova-compute[75216]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:17:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4604215000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fadb012-f0cb-4584-88bd-72de9e72ef5e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca3a64-e66e-4361-9573-711e1f87d167]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced529d-d34d-4b68-a111-5883aec6c39c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ba8da-5bb6-441d-9533-af450232590d]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_de92fdd8', '/dev/disk/by-id/scsi-1SCST_BIOde92fdd8-f2f78217ddc31c40', '/dev/disk/by-id/scsi-26632663738323137') {{(pid=86414) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2a7c3e-58fc-41e0-b6f8-8461e596f171]: (4, None) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb26bf-688f-4203-ad9b-efe5e9476357]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2719704-a64e-4f18-b88d-18eb6a1fe08d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260]
Nov 02 05:17:35 user nova-compute[75216]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a, portal: 172.16.0.220,3260] successful.
Nov 02 05:17:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4187fc-2d5f-42e7-bf66-9dd0f12dd89a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c21a36-94db-4154-8411-0b52b1b0aebe]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] <== disconnect_volume: return (336ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:17:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:17:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Deleting instance files /opt/stack/data/nova/instances/6bb2def8-34e6-4b4c-ab60-86f17a9a8567_del
Nov 02 05:17:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Deletion of /opt/stack/data/nova/instances/6bb2def8-34e6-4b4c-ab60-86f17a9a8567_del complete
Nov 02 05:17:36 user nova-compute[75216]: INFO nova.compute.manager [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 02 05:17:36 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:17:36 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Took 0.46 seconds to deallocate network for instance.
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-67402a0a-5e99-4a06-a9ec-26deee8d1995 req-bb9983d2-43a3-4bbb-a989-18c627601391 service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-vif-deleted-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-vif-unplugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] Acquiring lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] No waiting events found dispatching network-vif-unplugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-vif-unplugged-54e3673a-84ab-42ed-b84c-56454ab166bf for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received event network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] Acquiring lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] No waiting events found dispatching network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:17:36 user nova-compute[75216]: WARNING nova.compute.manager [req-ae48a9a2-1fc8-4d82-8a77-99aee23c010f req-f2385935-4a63-4125-b1e9-60ba3764b71c service nova] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Received unexpected event network-vif-plugged-54e3673a-84ab-42ed-b84c-56454ab166bf for instance with vm_state active and task_state deleting.
Nov 02 05:17:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:37 user nova-compute[75216]: INFO nova.compute.manager [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] [instance: 6bb2def8-34e6-4b4c-ab60-86f17a9a8567] Took 0.95 seconds to detach 1 volumes for instance.
Nov 02 05:17:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:37 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:17:37 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:17:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:37 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Deleted allocations for instance 6bb2def8-34e6-4b4c-ab60-86f17a9a8567
Nov 02 05:17:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7cf12fd6-c9d2-4b1a-a744-1cac4d53e7d4 tempest-TestVolumeBootPattern-773799094 tempest-TestVolumeBootPattern-773799094-project-member] Lock "6bb2def8-34e6-4b4c-ab60-86f17a9a8567" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.108s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:17:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:17:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:17:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:17:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:17:44 user nova-compute[75216]: INFO nova.compute.manager [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Detaching volume 1281a33a-5e81-4fd8-a489-4911e032782f
Nov 02 05:17:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:17:44 user nova-compute[75216]: INFO nova.virt.block_device [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attempting to driver detach volume 1281a33a-5e81-4fd8-a489-4911e032782f from mountpoint /dev/vdb
Nov 02 05:17:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Attempting to detach device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:17:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:17:44 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:17:44 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:17:44 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:17:44 user nova-compute[75216]:   <serial>1281a33a-5e81-4fd8-a489-4911e032782f</serial>
Nov 02 05:17:44 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:17:44 user nova-compute[75216]: </disk>
Nov 02 05:17:44 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:17:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config.
Nov 02 05:17:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:17:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:17:44 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:17:44 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:17:44 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:17:44 user nova-compute[75216]:   <serial>1281a33a-5e81-4fd8-a489-4911e032782f</serial>
Nov 02 05:17:44 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:17:44 user nova-compute[75216]: </disk>
Nov 02 05:17:44 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:17:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:17:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:17:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:18:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:18:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:18:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:04 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c is timed out.
Nov 02 05:18:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config.
Nov 02 05:18:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhNlYKpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:18:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c47eeaf-8a5c-48f1-92e0-89bd310ab6d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:18:04 user nova-compute[75216]: No targets found.
Nov 02 05:18:04 user nova-compute[75216]: iSNS:
Nov 02 05:18:04 user nova-compute[75216]: No targets found.
Nov 02 05:18:04 user nova-compute[75216]: STATIC:
Nov 02 05:18:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f
Nov 02 05:18:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:18:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:18:04 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:18:04 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:18:04 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:18:04 user nova-compute[75216]: FIRMWARE:
Nov 02 05:18:04 user nova-compute[75216]: No targets found.
Nov 02 05:18:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:18:04 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:18:04 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08ca249-f3f7-451d-95bb-3ee2d2ebc539]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da1829-648c-480f-ae58-f7ce018b7b69]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:18:04 user nova-compute[75216]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:18:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f (non-flash)
Nov 02 05:18:04 user nova-compute[75216]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:18:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460413d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:18:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d444f2-c746-4243-afc2-923386b4dc13]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[884b710c-31ba-40d4-9af2-5c914ce7895d]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47496efc-7119-4024-a3e8-3821623d8e6f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1a114-30da-4d91-be54-06e5425ce85b]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[646d0233-c410-4d37-8289-7168bcb20f1c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d3db5-2fc1-4245-850a-e03369c74dbd]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260]
Nov 02 05:18:05 user nova-compute[75216]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f, portal: 172.16.0.220,3260] successful.
Nov 02 05:18:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1281a33a-5e81-4fd8-a489-4911e032782f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf30fee7-993b-4622-ad38-ddd6bfc9c5af]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== disconnect_volume: return (297ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:18:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:18:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5be8b97e-587a-4cb2-bc09-bc211b40e310 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:18:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:18:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:18:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'flavor' on Instance uuid 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:25 user nova-compute[75216]: INFO nova.compute.manager [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Attaching volume 92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 to /dev/vdb
Nov 02 05:18:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG os_brick.utils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776707c-a751-4318-965f-3aeba7621db4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[65518997-898b-4e17-931b-19747987ee0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469ba10-af6c-4d01-90f5-992e18ac95fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e43e1-533c-449e-a8ad-c4e3be77ae87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:18:25 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:18:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dc77ce-fc35-417a-ae9c-cdba1aa12ee0]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG os_brick.utils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:18:25 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating existing volume attachment record: 6e7b1413-9c93-4793-aff1-1b02f44cc1b5 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:18:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:18:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:18:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=24.837665557861328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:18:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:18:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:40 user nova-compute[75216]: INFO nova.compute.manager [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attaching volume d94b3f61-08c2-4e0a-b2db-084280d29520 to /dev/vdb
Nov 02 05:18:40 user nova-compute[75216]: DEBUG os_brick.utils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[792d8977-b55e-4524-92b4-98bc4561ec09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b1a900-3bf0-49ce-b0e5-2f5733d17b6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[046bccfd-d54c-4416-8add-1b89ba5a709a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2313b3d-1cde-4438-b34e-7f6b68c14553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:18:41 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:18:41 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ffea7c-9d50-4309-8dc0-329eabcea1d6]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG os_brick.utils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating existing volume attachment record: cb3e2c12-d61a-4ecb-ad69-dcf12a51af0f {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [{"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-1ad38f2e-2d94-4437-b952-06bb0df47324" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:18:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:18:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSyPgFME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:18:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:18:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:18:44 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d1504-2367-49d1-abe1-acee4d522003]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:18:44 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac1f17d-6c69-4635-bcee-7a103286a986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5] added
Nov 02 05:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8536ce90-d908-4507-80fa-ef5ecfd093ab]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47816d44-6ee1-4cd2-958c-24ab46f7d5f2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSyPgFME {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSyPgFME" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cfeb02-e303-4527-a4ec-fa0501ec2fe0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSyPgFME'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdd1f45-53e0-480f-bf0d-de670f8438d8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a31f87-0149-421d-b6b2-896f148bbc96]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69940d98-aaa1-45b1-8bd9-e6be61133a4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260]
Nov 02 05:18:44 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260] successful.
Nov 02 05:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eedeb15-3d95-4c96-b365-3b45057dbf31]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e63c8a4-f848-4915-b68c-a5b07a649582]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:18:44 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:18:44 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[667600a0-c1ff-4dba-9a42-c4b06fa6641b]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSyPgFME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:18:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26132306135353935', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132306135353935', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'flavor' on Instance uuid 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:18:46 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:18:46 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:18:46 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:18:46 user nova-compute[75216]:   <serial>92d044f3-01ff-4faf-bcf7-b17cf38ca7a5</serial>
Nov 02 05:18:46 user nova-compute[75216]: </disk>
Nov 02 05:18:46 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] No VIF found with MAC fa:16:3e:7f:68:80, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:18:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-37ebb8cd-acd1-49d9-8a6f-35c7b14a6e65 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.364s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:18:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing instance network info cache due to event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:18:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:18:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:18:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:18:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updated VIF entry in instance network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:18:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:18:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c58ca85-1cb9-4e69-848a-f6ddf76819b9 req-cc4ee750-4ebb-4aea-8d0a-e18164261582 service nova] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:18:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing instance network info cache due to event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updated VIF entry in instance network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-92a5a29c-69bf-4422-9607-c3846254dc33 req-15ba2a29-7038-4b6d-83f2-2e3e2659a041 service nova] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:51 user nova-compute[75216]: INFO nova.compute.manager [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Rebooting instance
Nov 02 05:18:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:18:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:18:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:18:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:18:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Verify base images {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Image id 24d566e6-665e-4043-a961-22aeab2482de yields fingerprint c13353c3fb29102a5a55a3ad8aca40d4b769e04a {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 05:18:54 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] image 24d566e6-665e-4043-a961-22aeab2482de at (/opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a): checking
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] image 24d566e6-665e-4043-a961-22aeab2482de at (/opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a): image is in use {{(pid=75216) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Image id 68d67248-2499-473c-a9cd-909ea99614c1 yields fingerprint 498230a8c15b3522b23e57c4c66109c7b4a60fec {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 05:18:54 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] image 68d67248-2499-473c-a9cd-909ea99614c1 at (/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec): checking
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] image 68d67248-2499-473c-a9cd-909ea99614c1 at (/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec): image is in use {{(pid=75216) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] 0bf3440c-094c-4748-ba82-6502decfd65c is a valid instance name {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] 0bf3440c-094c-4748-ba82-6502decfd65c has a disk file {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c is backed by 498230a8c15b3522b23e57c4c66109c7b4a60fec {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 is a valid instance name {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 has a disk file {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 is backed by c13353c3fb29102a5a55a3ad8aca40d4b769e04a {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] 1ad38f2e-2d94-4437-b952-06bb0df47324 is a valid instance name {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] 1ad38f2e-2d94-4437-b952-06bb0df47324 has a disk file {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 is backed by 498230a8c15b3522b23e57c4c66109c7b4a60fec {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Active base files: /opt/stack/data/nova/instances/_base/c13353c3fb29102a5a55a3ad8aca40d4b769e04a /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Removable base files: /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600 /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6 /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3 /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42 /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9 /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/91eb738eef5b84582612ab2c47af79bb91931600
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5026b02256976d3d66e279c9a0ab7f4c3250fca6
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f77d1e159b7ca43f1e427358a1c8dcb37d29104a
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ed4e5e6884d69c86364d98ba81ee28cb5eb1fa3
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b17dd39d667d263a78bdf850b6c615d3cbb05e42
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fe59fb0297d1ed6a3806caee29e99b1183292ec9
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b8832b835d6d8f339689e0e2db7579f1b0a9cb1e
Nov 02 05:18:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Verification complete {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Verify swap images {{(pid=75216) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Verify ephemeral images {{(pid=75216) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-0907256c-cb44-4ec9-8320-7867a44235b9 req-559d870b-f4f7-4196-96df-8cf536a7ef8c service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-unplugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0907256c-cb44-4ec9-8320-7867a44235b9 req-559d870b-f4f7-4196-96df-8cf536a7ef8c service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0907256c-cb44-4ec9-8320-7867a44235b9 req-559d870b-f4f7-4196-96df-8cf536a7ef8c service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0907256c-cb44-4ec9-8320-7867a44235b9 req-559d870b-f4f7-4196-96df-8cf536a7ef8c service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-0907256c-cb44-4ec9-8320-7867a44235b9 req-559d870b-f4f7-4196-96df-8cf536a7ef8c service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-unplugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:18:55 user nova-compute[75216]: WARNING nova.compute.manager [req-0907256c-cb44-4ec9-8320-7867a44235b9 req-559d870b-f4f7-4196-96df-8cf536a7ef8c service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-unplugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state active and task_state reboot_started.
Nov 02 05:18:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance shutdown successfully.
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-9bc6677d-13d2-4430-9afd-09eb99ed7be7 req-a78a358e-2741-4f7f-99a2-2bdaa00dbb9f service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bc6677d-13d2-4430-9afd-09eb99ed7be7 req-a78a358e-2741-4f7f-99a2-2bdaa00dbb9f service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bc6677d-13d2-4430-9afd-09eb99ed7be7 req-a78a358e-2741-4f7f-99a2-2bdaa00dbb9f service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bc6677d-13d2-4430-9afd-09eb99ed7be7 req-a78a358e-2741-4f7f-99a2-2bdaa00dbb9f service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-9bc6677d-13d2-4430-9afd-09eb99ed7be7 req-a78a358e-2741-4f7f-99a2-2bdaa00dbb9f service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:18:57 user nova-compute[75216]: WARNING nova.compute.manager [req-9bc6677d-13d2-4430-9afd-09eb99ed7be7 req-a78a358e-2741-4f7f-99a2-2bdaa00dbb9f service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state active and task_state reboot_started.
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:18:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance running successfully.
Nov 02 05:18:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance soft rebooted successfully.
Nov 02 05:18:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f77c3963-8047-42c2-9a92-afe1183aa37f tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.355s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:18:59 user nova-compute[75216]: WARNING nova.compute.manager [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state active and task_state None.
Nov 02 05:18:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:18:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:18:59 user nova-compute[75216]: WARNING nova.compute.manager [req-39115863-8bf1-4a9e-84d1-1014d5754e44 req-efd1b537-fd03-43f2-a2c5-b0080d8c8984 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state active and task_state None.
Nov 02 05:19:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCQRsFKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:19:00 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:19:00 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:19:00 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ecffb-a81c-4245-9dc3-2e3eb816829b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:19:00 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17100b16-6bbc-4a55-99a5-35de7a8269e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520] added
Nov 02 05:19:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f458aaf8-a98d-4aee-a9a6-cac8bf67e89b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3972acb1-6932-4926-80bb-84c6b1dcb9c0]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCQRsFKo {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCQRsFKo" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c2e40-0808-485a-8d63-52c9d5ca3c82]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bCQRsFKo'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9756278-3782-4f08-b96b-2227899b86e2]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8dc5c7-0339-4caf-9e35-8a63d8a8c655]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:00 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:00 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f1107a-819e-42fb-beaa-9d7ad04b746a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260]
Nov 02 05:19:00 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260] successful.
Nov 02 05:19:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e053c2e7-9594-4150-96c4-dd2c56946c40]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9d8068-9c45-4f3c-97cc-81e3892a968a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:00 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:00 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 (non-flash)
Nov 02 05:19:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:00 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:00 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 (non-flash)
Nov 02 05:19:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e407c72-6d5a-4001-b513-cd392e86f704]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:19:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCQRsFKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:19:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:19:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23330636263383161', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:19:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330636263383161', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:19:01 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:19:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:19:01 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:19:01 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 05:19:01 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:19:01 user nova-compute[75216]:   <serial>d94b3f61-08c2-4e0a-b2db-084280d29520</serial>
Nov 02 05:19:01 user nova-compute[75216]: </disk>
Nov 02 05:19:01 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:19:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:19:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:19:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No VIF found with MAC fa:16:3e:e1:57:3b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:19:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9d81e000-7bff-4e2f-8d08-ea0d3f3d5ff3 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.429s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:04 user nova-compute[75216]: INFO nova.compute.manager [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Detaching volume d94b3f61-08c2-4e0a-b2db-084280d29520
Nov 02 05:19:04 user nova-compute[75216]: INFO nova.virt.block_device [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attempting to driver detach volume d94b3f61-08c2-4e0a-b2db-084280d29520 from mountpoint /dev/vdb
Nov 02 05:19:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Attempting to detach device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:19:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:19:04 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:19:04 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 05:19:04 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:19:04 user nova-compute[75216]:   <serial>d94b3f61-08c2-4e0a-b2db-084280d29520</serial>
Nov 02 05:19:04 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:19:04 user nova-compute[75216]: </disk>
Nov 02 05:19:04 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:19:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config.
Nov 02 05:19:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:19:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:19:04 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:19:04 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 02 05:19:04 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:19:04 user nova-compute[75216]:   <serial>d94b3f61-08c2-4e0a-b2db-084280d29520</serial>
Nov 02 05:19:04 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:19:04 user nova-compute[75216]: </disk>
Nov 02 05:19:04 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:19:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:19:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c is timed out.
Nov 02 05:19:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config.
Nov 02 05:19:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCQRsFKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:19:25 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cd8644-7b60-4730-abc6-900772906f99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:19:25 user nova-compute[75216]: No targets found.
Nov 02 05:19:25 user nova-compute[75216]: iSNS:
Nov 02 05:19:25 user nova-compute[75216]: No targets found.
Nov 02 05:19:25 user nova-compute[75216]: STATIC:
Nov 02 05:19:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5
Nov 02 05:19:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:19:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:19:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:19:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:19:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:19:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520
Nov 02 05:19:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:19:25 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:19:25 user nova-compute[75216]: FIRMWARE:
Nov 02 05:19:25 user nova-compute[75216]: No targets found.
Nov 02 05:19:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:19:25 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:19:25 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b0e38-223d-4a91-8155-dfae5ca590f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5356aed8-de74-4001-ae72-0d7329b08a66]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:25 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:25 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 (non-flash)
Nov 02 05:19:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:25 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:25 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 (non-flash)
Nov 02 05:19:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec3ac430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb3927-ba1e-42b3-8c3c-cb4d7e532484]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0dd6de-7d6e-4d6a-b730-0b33cb7eaa2b]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c07f49-ec11-449b-b703-19d42e1d1b6f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba43dbd-735c-4c46-8c77-f35a2fff6c0a]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d79c48a-7a48-4f1e-992c-fe0d8e22d90c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75550002-d4c7-4471-b749-593bb7fd5b81]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260]
Nov 02 05:19:25 user nova-compute[75216]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520, portal: 172.16.0.220,3260] successful.
Nov 02 05:19:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94b3f61-08c2-4e0a-b2db-084280d29520 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6605c8d1-180d-41ba-bf5c-3c78df1a5bc4]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== disconnect_volume: return (297ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:19:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:19:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:19:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1fd10d15-3053-49a3-b743-867266dd9ec5 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.853s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:19:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:19:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:19:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8639MB free_disk=24.83454132080078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 1ad38f2e-2d94-4437-b952-06bb0df47324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:19:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:19:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:19:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:39 user nova-compute[75216]: INFO nova.compute.manager [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Terminating instance
Nov 02 05:19:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-faf69da2-cb03-4a00-ab79-76bb250ce81e req-eeb82acb-7443-4488-9dc3-f70652f16bff service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-faf69da2-cb03-4a00-ab79-76bb250ce81e req-eeb82acb-7443-4488-9dc3-f70652f16bff service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-faf69da2-cb03-4a00-ab79-76bb250ce81e req-eeb82acb-7443-4488-9dc3-f70652f16bff service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-faf69da2-cb03-4a00-ab79-76bb250ce81e req-eeb82acb-7443-4488-9dc3-f70652f16bff service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-faf69da2-cb03-4a00-ab79-76bb250ce81e req-eeb82acb-7443-4488-9dc3-f70652f16bff service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:19:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-faf69da2-cb03-4a00-ab79-76bb250ce81e req-eeb82acb-7443-4488-9dc3-f70652f16bff service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-unplugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:19:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Instance destroyed successfully.
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lazy-loading 'resources' on Instance uuid 1ad38f2e-2d94-4437-b952-06bb0df47324 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-630037907',display_name='tempest-ServerActionsTestOtherB-server-630037907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-630037907',id=45,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtemq/mLByJ35/UzzO30FPZMPO+Yxs5kmCYH1L4jYUnWEsbkLxSzOvuDoNzvqKO8ZG+hLJarF0QffKqlrmKRxbfaEJ6WUnx50T50gx4CcUSz3xHcxXr3jW14Opuynwf1A==',key_name='tempest-keypair-211036464',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8f6cf0694e14e73be222dfc12e2c4fa',ramdisk_id='',reservation_id='r-cjnuo9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1123344217',owner_user_name='tempest-ServerActionsTestOtherB-1123344217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843262c7ee264eeeaefa636bb0b87566',uuid=1ad38f2e-2d94-4437-b952-06bb0df47324,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converting VIF {"id": "3432f410-eb55-42af-83be-5c46c4ba340f", "address": "fa:16:3e:1e:6e:0b", "network": {"id": "88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1641266520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8f6cf0694e14e73be222dfc12e2c4fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432f410-eb", "ovs_interfaceid": "3432f410-eb55-42af-83be-5c46c4ba340f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_vif [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3432f410-eb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=599de9d4-0402-4c0a-a0f6-cff4b5e8fd39) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:19:40 user nova-compute[75216]: INFO os_vif [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:6e:0b,bridge_name='br-int',has_traffic_filtering=True,id=3432f410-eb55-42af-83be-5c46c4ba340f,network=Network(88ff4ac4-c5d6-44f5-a0f4-3ffd7c27d1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432f410-eb')
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjyWniuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:19:40 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d64383c-8b9e-4e83-90bb-bfec3f8e3f0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:19:40 user nova-compute[75216]: No targets found.
Nov 02 05:19:40 user nova-compute[75216]: iSNS:
Nov 02 05:19:40 user nova-compute[75216]: No targets found.
Nov 02 05:19:40 user nova-compute[75216]: STATIC:
Nov 02 05:19:40 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5
Nov 02 05:19:40 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:19:40 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:19:40 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f
Nov 02 05:19:40 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:19:40 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:19:40 user nova-compute[75216]: FIRMWARE:
Nov 02 05:19:40 user nova-compute[75216]: No targets found.
Nov 02 05:19:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:19:40 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:19:40 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6da7a5e-8b28-46ad-bc27-6aa9bcade5ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f6b8f-825e-4fdb-9232-cbf85663dedb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:40 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f (non-flash)
Nov 02 05:19:40 user nova-compute[75216]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:19:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5d6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a57e2e-84f4-40fa-b7b4-228e6a2a9092]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf5546-a2bb-4973-bb91-02bbd3ea52e6]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70538fb3-aeb2-455b-9f87-56ac274f4e52]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba9d2d2-346f-4108-afb3-b8545a0323ff]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9022d9c9-6529-430b-a9e1-de40a0e795e5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df5ade-5ae7-44f8-8af3-5a84ffaec56d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260]
Nov 02 05:19:40 user nova-compute[75216]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f, portal: 172.16.0.220,3260] successful.
Nov 02 05:19:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58054ab4-c4a9-4cdc-a14d-fc425fee249f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbde5428-40b5-453c-8be6-34b0a430112d]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] <== disconnect_volume: return (324ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:19:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Deleting instance files /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324_del
Nov 02 05:19:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Deletion of /opt/stack/data/nova/instances/1ad38f2e-2d94-4437-b952-06bb0df47324_del complete
Nov 02 05:19:40 user nova-compute[75216]: INFO nova.compute.manager [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 05:19:40 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:19:40 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:19:41 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Took 0.78 seconds to deallocate network for instance.
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-e116f1f9-59cf-46a0-a7c8-b36ea67d7992 req-064259f2-1213-49a6-9fac-0161e0fcfb1d service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-deleted-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa9bf14d-99cb-4b6f-bf87-bb2247d157f8 req-0aa7f9b3-d305-4820-9530-d82068e937ef service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa9bf14d-99cb-4b6f-bf87-bb2247d157f8 req-0aa7f9b3-d305-4820-9530-d82068e937ef service nova] Acquiring lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa9bf14d-99cb-4b6f-bf87-bb2247d157f8 req-0aa7f9b3-d305-4820-9530-d82068e937ef service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa9bf14d-99cb-4b6f-bf87-bb2247d157f8 req-0aa7f9b3-d305-4820-9530-d82068e937ef service nova] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa9bf14d-99cb-4b6f-bf87-bb2247d157f8 req-0aa7f9b3-d305-4820-9530-d82068e937ef service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] No waiting events found dispatching network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:19:41 user nova-compute[75216]: WARNING nova.compute.manager [req-fa9bf14d-99cb-4b6f-bf87-bb2247d157f8 req-0aa7f9b3-d305-4820-9530-d82068e937ef service nova] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Received unexpected event network-vif-plugged-3432f410-eb55-42af-83be-5c46c4ba340f for instance with vm_state active and task_state deleting.
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating instance_info_cache with network_info: [{"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:19:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:19:42 user nova-compute[75216]: INFO nova.compute.manager [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] [instance: 1ad38f2e-2d94-4437-b952-06bb0df47324] Took 0.83 seconds to detach 1 volumes for instance.
Nov 02 05:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:19:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:19:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:19:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:42 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Deleted allocations for instance 1ad38f2e-2d94-4437-b952-06bb0df47324
Nov 02 05:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b48b7d21-bbcf-4daa-a81e-33626f46cc01 tempest-ServerActionsTestOtherB-1123344217 tempest-ServerActionsTestOtherB-1123344217-project-member] Lock "1ad38f2e-2d94-4437-b952-06bb0df47324" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.164s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:19:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:19:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:19:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:19:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:20:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:20:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:20:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:20:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG nova.objects.instance [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:01 user nova-compute[75216]: INFO nova.compute.manager [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attaching volume 43ffa5d9-c62e-495f-9d65-c192b679840e to /dev/vdb
Nov 02 05:20:01 user nova-compute[75216]: DEBUG os_brick.utils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88785245-0acd-4191-9abf-3408f65cc148]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41905e63-19ac-4a6e-8c75-2fd3ff560533]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52f6fb-a318-4d98-8c3d-f02a34aa6f1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e33386-cd0a-43ca-88cb-f85e3b10f789]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:20:01 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:20:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a7556-9ec5-419c-8a9d-46b7406e8489]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG os_brick.utils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:20:01 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating existing volume attachment record: 92da6c8f-79d2-458d-b009-5bc77250f070 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:20:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPdpyLOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:20:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:20:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:20:19 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6da74f-9a5c-42cc-a197-cd85a1e6ab7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:20:19 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b9d926-ec23-499b-8511-9f3fc1c053cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e] added
Nov 02 05:20:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[59da13fe-bb07-450c-97e6-9482f4d9cd50]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784aeaf-b1c9-4ead-b89e-dfa20aa2baad]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPdpyLOi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPdpyLOi" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a227050-8ec2-41ed-9916-68240d633016]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FPdpyLOi'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[907f678d-1532-4087-9701-11faba5b85fa]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a02e2d7-d4af-43b7-aea2-d569e4373e0f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:20:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:20:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de59dee3-c85d-4df5-ae33-1528a338c08c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260]
Nov 02 05:20:20 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260] successful.
Nov 02 05:20:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda97225-ec4d-4788-afae-053a6589c8cf]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70bf478-5207-4f97-a6cf-a3d221b1e2b4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:20:20 user nova-compute[75216]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e (non-flash)
Nov 02 05:20:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:20:20 user nova-compute[75216]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e (non-flash)
Nov 02 05:20:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16a51d-bc4d-469d-8b8b-20627ad92dd8]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:20:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPdpyLOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26133636663373035', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133636663373035', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:20:21 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:20:21 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 05:20:21 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:20:21 user nova-compute[75216]:   <serial>43ffa5d9-c62e-495f-9d65-c192b679840e</serial>
Nov 02 05:20:21 user nova-compute[75216]: </disk>
Nov 02 05:20:21 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No VIF found with MAC fa:16:3e:e1:57:3b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:20:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-183129dc-97e6-4fbc-80a0-90bb329eea2c tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.232s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:24 user nova-compute[75216]: INFO nova.compute.manager [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Detaching volume 43ffa5d9-c62e-495f-9d65-c192b679840e
Nov 02 05:20:24 user nova-compute[75216]: INFO nova.virt.block_device [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attempting to driver detach volume 43ffa5d9-c62e-495f-9d65-c192b679840e from mountpoint /dev/vdb
Nov 02 05:20:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Attempting to detach device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:20:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:20:24 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:20:24 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 05:20:24 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:20:24 user nova-compute[75216]:   <serial>43ffa5d9-c62e-495f-9d65-c192b679840e</serial>
Nov 02 05:20:24 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:20:24 user nova-compute[75216]: </disk>
Nov 02 05:20:24 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:20:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config.
Nov 02 05:20:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:20:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:20:24 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:20:24 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 02 05:20:24 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:20:24 user nova-compute[75216]:   <serial>43ffa5d9-c62e-495f-9d65-c192b679840e</serial>
Nov 02 05:20:24 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:20:24 user nova-compute[75216]: </disk>
Nov 02 05:20:24 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:20:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:20:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:20:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:34 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:20:34 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.861228942871094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:20:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:20:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing instance network info cache due to event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:20:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updated VIF entry in instance network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-239b2801-be34-4051-baf2-3f4e9b92975c req-cf90f31b-8de3-46b3-bce3-b3b07ed49dd7 service nova] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:20:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c is timed out.
Nov 02 05:20:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config.
Nov 02 05:20:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPdpyLOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:20:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc27057-7df6-4306-bc00-a029e4c51003]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:20:44 user nova-compute[75216]: No targets found.
Nov 02 05:20:44 user nova-compute[75216]: iSNS:
Nov 02 05:20:44 user nova-compute[75216]: No targets found.
Nov 02 05:20:44 user nova-compute[75216]: STATIC:
Nov 02 05:20:44 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5
Nov 02 05:20:44 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:20:44 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:20:44 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e
Nov 02 05:20:44 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:20:44 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:20:44 user nova-compute[75216]: FIRMWARE:
Nov 02 05:20:44 user nova-compute[75216]: No targets found.
Nov 02 05:20:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:20:44 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:20:44 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:44 user nova-compute[75216]: INFO nova.compute.manager [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Detaching volume 92d044f3-01ff-4faf-bcf7-b17cf38ca7a5
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e26a5-6c39-4e05-9044-27e9372857aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a59631-8bfa-4468-8e3f-20fa84b8b668]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:20:44 user nova-compute[75216]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e (non-flash)
Nov 02 05:20:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:20:44 user nova-compute[75216]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e (non-flash)
Nov 02 05:20:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec453760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:20:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea7352-a6a8-4bd8-bb13-aba606f02834]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:45 user nova-compute[75216]: INFO nova.virt.block_device [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Attempting to driver detach volume 92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 from mountpoint /dev/vdb
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Attempting to detach device vdb from instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:20:45 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:20:45 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:20:45 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:20:45 user nova-compute[75216]:   <serial>92d044f3-01ff-4faf-bcf7-b17cf38ca7a5</serial>
Nov 02 05:20:45 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:20:45 user nova-compute[75216]: </disk>
Nov 02 05:20:45 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:20:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully detached device vdb from instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 from the persistent domain config.
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:20:45 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:20:45 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:20:45 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:20:45 user nova-compute[75216]:   <serial>92d044f3-01ff-4faf-bcf7-b17cf38ca7a5</serial>
Nov 02 05:20:45 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:20:45 user nova-compute[75216]: </disk>
Nov 02 05:20:45 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aba21f-9267-4ddf-adca-2288bb7e1989]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[13046991-e2a7-498a-9eaf-2447105ee482]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a0b842-45df-43f1-889a-96d05ab747d9]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5a51c7-e4ed-432e-830e-8fbc5792b556]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[05142e08-0182-48d2-98f9-efef87513487]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260]
Nov 02 05:20:45 user nova-compute[75216]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e, portal: 172.16.0.220,3260] successful.
Nov 02 05:20:45 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ffa5d9-c62e-495f-9d65-c192b679840e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7daf640-d75e-44cf-9506-b3ef69520eff]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== disconnect_volume: return (350ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing instance network info cache due to event network-changed-057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] Acquiring lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] Acquired lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:20:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Refreshing network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:20:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updated VIF entry in instance network info cache for port 057fe2b6-edae-428a-af80-4dc3475118c6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:20:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [{"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:20:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af956e84-d333-46a4-8774-43dd0af94dfa req-ab26e500-0be8-4abd-940d-a0ebb94496c1 service nova] Releasing lock "refresh_cache-4f7dea1b-7916-4d4e-b0c2-d4e111513f21" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:20:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:20:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-89b5e96d-fe38-4f14-a40b-96a43d54c7dc tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.845s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.591s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "9dd925a2-8024-4922-933c-b219cb623a24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:20:51 user nova-compute[75216]: INFO nova.compute.claims [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Claim successful on node user
Nov 02 05:20:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:20:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.policy [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a054457281864930a9803e8ce901dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2dbfd63fb4326ba4d9eeb8bef7992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:20:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Creating image(s)
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.113s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:20:52 user nova-compute[75216]: INFO nova.compute.claims [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Claim successful on node user
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk 1073741824" returned: 0 in 0.066s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Successfully created port: 9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:20:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.policy [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a054457281864930a9803e8ce901dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2dbfd63fb4326ba4d9eeb8bef7992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:20:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Creating image(s)
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Cannot resize image /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Ensure instance console log exists: /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Successfully created port: e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk 1073741824" returned: 0 in 0.056s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Successfully updated port: 9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-changed-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Refreshing instance network info cache due to event network-changed-9ac045d0-585a-4a65-880d-1db5d9f63fd7. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Cannot resize image /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Ensure instance console log exists: /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance network_info: |[{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Refreshing network info cache for port 9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Start _get_guest_xml network_info=[{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:20:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:20:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-437711847',display_name='tempest-ServerRescueNegativeTestJSON-server-437711847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-437711847',id=50,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-m4odo907',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:20:52Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=9dd925a2-8024-4922-933c-b219cb623a24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:20:53 user nova-compute[75216]:   <uuid>9dd925a2-8024-4922-933c-b219cb623a24</uuid>
Nov 02 05:20:53 user nova-compute[75216]:   <name>instance-00000032</name>
Nov 02 05:20:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:20:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:20:53 user nova-compute[75216]:   <metadata>
Nov 02 05:20:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:20:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:20:53 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-437711847</nova:name>
Nov 02 05:20:53 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:20:53</nova:creationTime>
Nov 02 05:20:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:20:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:20:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:20:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:20:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:20:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:20:53 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:20:53 user nova-compute[75216]:       <nova:owner>
Nov 02 05:20:53 user nova-compute[75216]:         <nova:user uuid="a054457281864930a9803e8ce901dcd0">tempest-ServerRescueNegativeTestJSON-979818861-project-member</nova:user>
Nov 02 05:20:53 user nova-compute[75216]:         <nova:project uuid="89d2dbfd63fb4326ba4d9eeb8bef7992">tempest-ServerRescueNegativeTestJSON-979818861</nova:project>
Nov 02 05:20:53 user nova-compute[75216]:       </nova:owner>
Nov 02 05:20:53 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:20:53 user nova-compute[75216]:       <nova:ports>
Nov 02 05:20:53 user nova-compute[75216]:         <nova:port uuid="9ac045d0-585a-4a65-880d-1db5d9f63fd7">
Nov 02 05:20:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 05:20:53 user nova-compute[75216]:         </nova:port>
Nov 02 05:20:53 user nova-compute[75216]:       </nova:ports>
Nov 02 05:20:53 user nova-compute[75216]:     </nova:instance>
Nov 02 05:20:53 user nova-compute[75216]:   </metadata>
Nov 02 05:20:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:20:53 user nova-compute[75216]:     <system>
Nov 02 05:20:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:20:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:20:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:20:53 user nova-compute[75216]:       <entry name="serial">9dd925a2-8024-4922-933c-b219cb623a24</entry>
Nov 02 05:20:53 user nova-compute[75216]:       <entry name="uuid">9dd925a2-8024-4922-933c-b219cb623a24</entry>
Nov 02 05:20:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:20:53 user nova-compute[75216]:     </system>
Nov 02 05:20:53 user nova-compute[75216]:   </sysinfo>
Nov 02 05:20:53 user nova-compute[75216]:   <os>
Nov 02 05:20:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:20:53 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:20:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:20:53 user nova-compute[75216]:   </os>
Nov 02 05:20:53 user nova-compute[75216]:   <features>
Nov 02 05:20:53 user nova-compute[75216]:     <acpi/>
Nov 02 05:20:53 user nova-compute[75216]:     <apic/>
Nov 02 05:20:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:20:53 user nova-compute[75216]:   </features>
Nov 02 05:20:53 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:20:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:20:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:20:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:20:53 user nova-compute[75216]:   </clock>
Nov 02 05:20:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:20:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:20:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:20:53 user nova-compute[75216]:   </cpu>
Nov 02 05:20:53 user nova-compute[75216]:   <devices>
Nov 02 05:20:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:20:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:20:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk"/>
Nov 02 05:20:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:20:53 user nova-compute[75216]:     </disk>
Nov 02 05:20:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:20:53 user nova-compute[75216]:       <mac address="fa:16:3e:62:78:db"/>
Nov 02 05:20:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:20:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:20:53 user nova-compute[75216]:       <target dev="tap9ac045d0-58"/>
Nov 02 05:20:53 user nova-compute[75216]:     </interface>
Nov 02 05:20:53 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:20:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/console.log" append="off"/>
Nov 02 05:20:53 user nova-compute[75216]:     </serial>
Nov 02 05:20:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:20:53 user nova-compute[75216]:     <video>
Nov 02 05:20:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:20:53 user nova-compute[75216]:     </video>
Nov 02 05:20:53 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:20:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:20:53 user nova-compute[75216]:     </rng>
Nov 02 05:20:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:20:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:20:53 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:20:53 user nova-compute[75216]:     </memballoon>
Nov 02 05:20:53 user nova-compute[75216]:   </devices>
Nov 02 05:20:53 user nova-compute[75216]: </domain>
Nov 02 05:20:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-437711847',display_name='tempest-ServerRescueNegativeTestJSON-server-437711847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-437711847',id=50,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-m4odo907',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:20:52Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=9dd925a2-8024-4922-933c-b219cb623a24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG os_vif [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e080d1d-fb74-5db6-8e5f-76577a5eec93', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ac045d0-58, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ac045d0-58, col_values=(('qos', UUID('46eb157b-e135-4949-b3af-be4a80a70ddf')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ac045d0-58, col_values=(('external_ids', {'iface-id': '9ac045d0-585a-4a65-880d-1db5d9f63fd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:78:db', 'vm-uuid': '9dd925a2-8024-4922-933c-b219cb623a24'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:53 user nova-compute[75216]: INFO os_vif [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58')
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No VIF found with MAC fa:16:3e:62:78:db, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Successfully updated port: e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-changed-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Refreshing instance network info cache due to event network-changed-e88b951e-365c-4a37-98ee-db33fc9a342c. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated VIF entry in instance network info cache for port 9ac045d0-585a-4a65-880d-1db5d9f63fd7. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-408273f3-54ad-4bde-a150-23915f2c5c16 req-5ac32613-18f6-4fac-8130-4c7e162f5f8b service nova] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance network_info: |[{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Refreshing network info cache for port e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Start _get_guest_xml network_info=[{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:20:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:20:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179035485',display_name='tempest-ServerRescueNegativeTestJSON-server-1179035485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179035485',id=51,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-j7cnv5g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:20:53Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=649e6f30-7b44-4cfa-8163-75ea92e2d030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'pci_devices' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:20:54 user nova-compute[75216]:   <uuid>649e6f30-7b44-4cfa-8163-75ea92e2d030</uuid>
Nov 02 05:20:54 user nova-compute[75216]:   <name>instance-00000033</name>
Nov 02 05:20:54 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:20:54 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:20:54 user nova-compute[75216]:   <metadata>
Nov 02 05:20:54 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:20:54 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:20:54 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1179035485</nova:name>
Nov 02 05:20:54 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:20:54</nova:creationTime>
Nov 02 05:20:54 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:20:54 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:20:54 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:20:54 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:20:54 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:20:54 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:20:54 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:20:54 user nova-compute[75216]:       <nova:owner>
Nov 02 05:20:54 user nova-compute[75216]:         <nova:user uuid="a054457281864930a9803e8ce901dcd0">tempest-ServerRescueNegativeTestJSON-979818861-project-member</nova:user>
Nov 02 05:20:54 user nova-compute[75216]:         <nova:project uuid="89d2dbfd63fb4326ba4d9eeb8bef7992">tempest-ServerRescueNegativeTestJSON-979818861</nova:project>
Nov 02 05:20:54 user nova-compute[75216]:       </nova:owner>
Nov 02 05:20:54 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:20:54 user nova-compute[75216]:       <nova:ports>
Nov 02 05:20:54 user nova-compute[75216]:         <nova:port uuid="e88b951e-365c-4a37-98ee-db33fc9a342c">
Nov 02 05:20:54 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 05:20:54 user nova-compute[75216]:         </nova:port>
Nov 02 05:20:54 user nova-compute[75216]:       </nova:ports>
Nov 02 05:20:54 user nova-compute[75216]:     </nova:instance>
Nov 02 05:20:54 user nova-compute[75216]:   </metadata>
Nov 02 05:20:54 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:20:54 user nova-compute[75216]:     <system>
Nov 02 05:20:54 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:20:54 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:20:54 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:20:54 user nova-compute[75216]:       <entry name="serial">649e6f30-7b44-4cfa-8163-75ea92e2d030</entry>
Nov 02 05:20:54 user nova-compute[75216]:       <entry name="uuid">649e6f30-7b44-4cfa-8163-75ea92e2d030</entry>
Nov 02 05:20:54 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:20:54 user nova-compute[75216]:     </system>
Nov 02 05:20:54 user nova-compute[75216]:   </sysinfo>
Nov 02 05:20:54 user nova-compute[75216]:   <os>
Nov 02 05:20:54 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:20:54 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:20:54 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:20:54 user nova-compute[75216]:   </os>
Nov 02 05:20:54 user nova-compute[75216]:   <features>
Nov 02 05:20:54 user nova-compute[75216]:     <acpi/>
Nov 02 05:20:54 user nova-compute[75216]:     <apic/>
Nov 02 05:20:54 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:20:54 user nova-compute[75216]:   </features>
Nov 02 05:20:54 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:20:54 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:20:54 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:20:54 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:20:54 user nova-compute[75216]:   </clock>
Nov 02 05:20:54 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:20:54 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:20:54 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:20:54 user nova-compute[75216]:   </cpu>
Nov 02 05:20:54 user nova-compute[75216]:   <devices>
Nov 02 05:20:54 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:20:54 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:20:54 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk"/>
Nov 02 05:20:54 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:20:54 user nova-compute[75216]:     </disk>
Nov 02 05:20:54 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:20:54 user nova-compute[75216]:       <mac address="fa:16:3e:0e:fc:a7"/>
Nov 02 05:20:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:20:54 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:20:54 user nova-compute[75216]:       <target dev="tape88b951e-36"/>
Nov 02 05:20:54 user nova-compute[75216]:     </interface>
Nov 02 05:20:54 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:20:54 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/console.log" append="off"/>
Nov 02 05:20:54 user nova-compute[75216]:     </serial>
Nov 02 05:20:54 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:20:54 user nova-compute[75216]:     <video>
Nov 02 05:20:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:20:54 user nova-compute[75216]:     </video>
Nov 02 05:20:54 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:20:54 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:20:54 user nova-compute[75216]:     </rng>
Nov 02 05:20:54 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:20:54 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:20:54 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:20:54 user nova-compute[75216]:     </memballoon>
Nov 02 05:20:54 user nova-compute[75216]:   </devices>
Nov 02 05:20:54 user nova-compute[75216]: </domain>
Nov 02 05:20:54 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179035485',display_name='tempest-ServerRescueNegativeTestJSON-server-1179035485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179035485',id=51,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-j7cnv5g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:20:53Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=649e6f30-7b44-4cfa-8163-75ea92e2d030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG os_vif [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bdc8792-39a5-5f14-8b17-07c7097b58e5', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape88b951e-36, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape88b951e-36, col_values=(('qos', UUID('b55e0453-108b-49e9-a51f-a0f0d1adfda2')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape88b951e-36, col_values=(('external_ids', {'iface-id': 'e88b951e-365c-4a37-98ee-db33fc9a342c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:fc:a7', 'vm-uuid': '649e6f30-7b44-4cfa-8163-75ea92e2d030'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:54 user nova-compute[75216]: INFO os_vif [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36')
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No VIF found with MAC fa:16:3e:0e:fc:a7, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updated VIF entry in instance network info cache for port e88b951e-365c-4a37-98ee-db33fc9a342c. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:20:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bfcbb6d-5f0d-41db-8890-96d79c0b77aa req-42c3c765-5fa7-4d52-afbc-8a6ef26c617f service nova] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:20:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:20:56 user nova-compute[75216]: WARNING nova.compute.manager [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state building and task_state spawning.
Nov 02 05:20:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:20:56 user nova-compute[75216]: WARNING nova.compute.manager [req-c28f06a2-c16b-4bd2-851e-a9de0b846c75 req-be025de0-981f-4bbb-82a9-ce6629f7b7eb service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state building and task_state spawning.
Nov 02 05:20:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-5ba62025-c3e3-4564-9e2c-5c77363f4fc2 req-ac41dcdd-fd83-4378-996f-8575f9ccf0e2 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ba62025-c3e3-4564-9e2c-5c77363f4fc2 req-ac41dcdd-fd83-4378-996f-8575f9ccf0e2 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ba62025-c3e3-4564-9e2c-5c77363f4fc2 req-ac41dcdd-fd83-4378-996f-8575f9ccf0e2 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ba62025-c3e3-4564-9e2c-5c77363f4fc2 req-ac41dcdd-fd83-4378-996f-8575f9ccf0e2 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-5ba62025-c3e3-4564-9e2c-5c77363f4fc2 req-ac41dcdd-fd83-4378-996f-8575f9ccf0e2 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:20:57 user nova-compute[75216]: WARNING nova.compute.manager [req-5ba62025-c3e3-4564-9e2c-5c77363f4fc2 req-ac41dcdd-fd83-4378-996f-8575f9ccf0e2 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state building and task_state spawning.
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:20:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance spawned successfully.
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:20:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance spawned successfully.
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:20:59 user nova-compute[75216]: INFO nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:20:59 user nova-compute[75216]: INFO nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:20:59 user nova-compute[75216]: INFO nova.compute.manager [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Took 7.51 seconds to build instance.
Nov 02 05:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-95689a2c-8d43-4e9b-93cc-10972057b965 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "9dd925a2-8024-4922-933c-b219cb623a24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.597s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:59 user nova-compute[75216]: INFO nova.compute.manager [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Took 7.13 seconds to build instance.
Nov 02 05:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7790f988-3fa7-4f49-a1fa-9bea2cd7c43d tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.226s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-f633df3d-2ea5-4c33-9810-09fe99e412bc req-564286f9-c083-4f8b-bb9e-3fc76e613905 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f633df3d-2ea5-4c33-9810-09fe99e412bc req-564286f9-c083-4f8b-bb9e-3fc76e613905 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f633df3d-2ea5-4c33-9810-09fe99e412bc req-564286f9-c083-4f8b-bb9e-3fc76e613905 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f633df3d-2ea5-4c33-9810-09fe99e412bc req-564286f9-c083-4f8b-bb9e-3fc76e613905 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:20:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-f633df3d-2ea5-4c33-9810-09fe99e412bc req-564286f9-c083-4f8b-bb9e-3fc76e613905 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:20:59 user nova-compute[75216]: WARNING nova.compute.manager [req-f633df3d-2ea5-4c33-9810-09fe99e412bc req-564286f9-c083-4f8b-bb9e-3fc76e613905 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state active and task_state None.
Nov 02 05:20:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 is timed out.
Nov 02 05:21:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully detached device vdb from instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 from the live domain config.
Nov 02 05:21:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSyPgFME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:21:05 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9adffa9-0b64-4f8f-ba06-f5dc0fcee1e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:21:05 user nova-compute[75216]: No targets found.
Nov 02 05:21:05 user nova-compute[75216]: iSNS:
Nov 02 05:21:05 user nova-compute[75216]: No targets found.
Nov 02 05:21:05 user nova-compute[75216]: STATIC:
Nov 02 05:21:05 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5
Nov 02 05:21:05 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:21:05 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:21:05 user nova-compute[75216]: FIRMWARE:
Nov 02 05:21:05 user nova-compute[75216]: No targets found.
Nov 02 05:21:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:21:05 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:21:05 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[522745cf-182b-4ea6-93dd-4e7a07b69172]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c97e1ff-7c0a-4d78-ac89-2143f31ba2fc]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:21:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 (non-flash)
Nov 02 05:21:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec477130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e182f1c-6fa6-4880-9627-62b6804f3bbe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8812cf-2242-4866-a384-ed5822269a53]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2aeca-b6fe-4a3c-9bf0-08ba56d1170b]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea08f97-dbbc-4ab7-ac5c-23c04e31c669]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3c1619-db9e-4660-94c9-cc231e818405]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1821ef48-1d49-4564-aae9-b4967de31e62]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260]
Nov 02 05:21:05 user nova-compute[75216]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5, portal: 172.16.0.220,3260] successful.
Nov 02 05:21:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d044f3-01ff-4faf-bcf7-b17cf38ca7a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a47fa4e-61f1-4304-9f6a-fad3931b0229]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] <== disconnect_volume: return (298ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:21:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:21:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'flavor' on Instance uuid 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:21:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c7856257-d616-408a-a259-b31eaa10acc7 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:19 user nova-compute[75216]: INFO nova.compute.manager [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attaching volume aa4d4456-9946-4348-bc05-c00c32c27218 to /dev/vdb
Nov 02 05:21:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfd793c-68a6-4301-aaae-a37aa24097dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29335bad-6761-40e2-bd2c-8a3c7adcb1d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebbf4a1-1098-424f-95de-9017cb02379e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f252d82a-dc31-4193-b1aa-d8704846de4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:21:19 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:21:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b1e1e-f495-4f3a-b22f-a1adcd993395]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG os_brick.utils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:21:19 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating existing volume attachment record: 47acefe2-b9b9-4ded-b5f2-a6773909b9b5 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:21:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:36 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:21:36 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8485MB free_disk=24.793964385986328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:21:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtzBFroQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:21:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:21:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:21:38 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f34f5a-f501-4b80-9e74-f40e8613cd81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:21:38 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f5c615-2ac7-43ef-95e9-953791858447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218] added
Nov 02 05:21:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0203c792-0959-4fb9-8983-d56902f8fecc]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1323c4de-cc4d-4d66-a2ff-8c4e44e5788e]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtzBFroQ {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtzBFroQ" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddec8c5-65f6-4e20-9d0f-92a087ef0763]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qtzBFroQ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb33b5c-e39c-4d1c-82db-38477c015207]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61fb301-fb87-4342-9d31-0f99fa0d76a1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:21:38 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:21:38 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:21:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 05:21:38 user nova-compute[75216]: 
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb442c16-9d3b-4472-af67-8624571fbafb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260]
Nov 02 05:21:38 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260] successful.
Nov 02 05:21:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef219311-97f3-4c80-8c1f-9f30deda0522]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288d976-af29-4b4d-a467-7c9aa7a2bdeb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 (non-flash)
Nov 02 05:21:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 (non-flash)
Nov 02 05:21:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6cbbeb-0292-499e-a8df-44c942f8ccc9]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:21:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtzBFroQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23037363835326133', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037363835326133', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:21:39 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:21:39 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:21:39 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:21:39 user nova-compute[75216]:   <serial>aa4d4456-9946-4348-bc05-c00c32c27218</serial>
Nov 02 05:21:39 user nova-compute[75216]: </disk>
Nov 02 05:21:39 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:21:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] No VIF found with MAC fa:16:3e:e1:57:3b, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:21:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-355d129a-8230-4517-9f8a-d65a9ca63178 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.402s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:42 user nova-compute[75216]: INFO nova.compute.manager [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Detaching volume aa4d4456-9946-4348-bc05-c00c32c27218
Nov 02 05:21:42 user nova-compute[75216]: INFO nova.virt.block_device [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Attempting to driver detach volume aa4d4456-9946-4348-bc05-c00c32c27218 from mountpoint /dev/vdb
Nov 02 05:21:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Attempting to detach device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:21:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:21:42 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:21:42 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:21:42 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:21:42 user nova-compute[75216]:   <serial>aa4d4456-9946-4348-bc05-c00c32c27218</serial>
Nov 02 05:21:42 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:21:42 user nova-compute[75216]: </disk>
Nov 02 05:21:42 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:21:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the persistent domain config.
Nov 02 05:21:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:21:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:21:42 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:21:42 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:21:42 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:21:42 user nova-compute[75216]:   <serial>aa4d4456-9946-4348-bc05-c00c32c27218</serial>
Nov 02 05:21:42 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:21:42 user nova-compute[75216]: </disk>
Nov 02 05:21:42 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:21:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating instance_info_cache with network_info: [{"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-0bf3440c-094c-4748-ba82-6502decfd65c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:21:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:46 user nova-compute[75216]: INFO nova.compute.manager [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Terminating instance
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-5481d847-e190-449f-ad4e-073164f64ff4 req-aed385ee-e61f-4bac-bb53-6c9907a88c1a service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-unplugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5481d847-e190-449f-ad4e-073164f64ff4 req-aed385ee-e61f-4bac-bb53-6c9907a88c1a service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5481d847-e190-449f-ad4e-073164f64ff4 req-aed385ee-e61f-4bac-bb53-6c9907a88c1a service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5481d847-e190-449f-ad4e-073164f64ff4 req-aed385ee-e61f-4bac-bb53-6c9907a88c1a service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-5481d847-e190-449f-ad4e-073164f64ff4 req-aed385ee-e61f-4bac-bb53-6c9907a88c1a service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-unplugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-5481d847-e190-449f-ad4e-073164f64ff4 req-aed385ee-e61f-4bac-bb53-6c9907a88c1a service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-unplugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Instance destroyed successfully.
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lazy-loading 'resources' on Instance uuid 4f7dea1b-7916-4d4e-b0c2-d4e111513f21 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1432773736',display_name='tempest-TestMinimumBasicScenario-server-1432773736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1432773736',id=49,image_ref='24d566e6-665e-4043-a961-22aeab2482de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0BJKcLkwB2uxIrYja6jr96tA0vCcxDANWFNDiSj95ghdSmZgayVU6nSABdFb8zsZzYSClOsAvbi8CKPFvIECsZh2VXJyxj7mE1VKsvWGEbC8E2keFtSp9K2pSc00srog==',key_name='tempest-TestMinimumBasicScenario-1282687824',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0bbd2a0fea340eda045059153a3ed9f',ramdisk_id='',reservation_id='r-9rkaaet7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24d566e6-665e-4043-a961-22aeab2482de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1935471528',owner_user_name='tempest-TestMinimumBasicScenario-1935471528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:18:59Z,user_data=None,user_id='8a60b807f9454e49917d372178cc196f',uuid=4f7dea1b-7916-4d4e-b0c2-d4e111513f21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converting VIF {"id": "057fe2b6-edae-428a-af80-4dc3475118c6", "address": "fa:16:3e:7f:68:80", "network": {"id": "774a4bc5-1f85-40ed-a5b0-de56a11b3868", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-75804775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bbd2a0fea340eda045059153a3ed9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057fe2b6-ed", "ovs_interfaceid": "057fe2b6-edae-428a-af80-4dc3475118c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:68:80,bridge_name='br-int',has_traffic_filtering=True,id=057fe2b6-edae-428a-af80-4dc3475118c6,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057fe2b6-ed') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG os_vif [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:68:80,bridge_name='br-int',has_traffic_filtering=True,id=057fe2b6-edae-428a-af80-4dc3475118c6,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057fe2b6-ed') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap057fe2b6-ed, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d32449f0-ba1e-4af7-98ed-1cdd2f63a609) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:21:46 user nova-compute[75216]: INFO os_vif [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:68:80,bridge_name='br-int',has_traffic_filtering=True,id=057fe2b6-edae-428a-af80-4dc3475118c6,network=Network(774a4bc5-1f85-40ed-a5b0-de56a11b3868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057fe2b6-ed')
Nov 02 05:21:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Deleting instance files /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21_del
Nov 02 05:21:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Deletion of /opt/stack/data/nova/instances/4f7dea1b-7916-4d4e-b0c2-d4e111513f21_del complete
Nov 02 05:21:46 user nova-compute[75216]: INFO nova.compute.manager [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 05:21:46 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:21:46 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:21:47 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Took 0.72 seconds to deallocate network for instance.
Nov 02 05:21:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:47 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Deleted allocations for instance 4f7dea1b-7916-4d4e-b0c2-d4e111513f21
Nov 02 05:21:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:21:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-75adcb3e-8177-4790-915a-a259dc093875 tempest-TestMinimumBasicScenario-1935471528 tempest-TestMinimumBasicScenario-1935471528-project-member] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:21:48 user nova-compute[75216]: WARNING nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state deleted and task_state None.
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:21:48 user nova-compute[75216]: WARNING nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state deleted and task_state None.
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:21:48 user nova-compute[75216]: WARNING nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state deleted and task_state None.
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Acquiring lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] Lock "4f7dea1b-7916-4d4e-b0c2-d4e111513f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] No waiting events found dispatching network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:21:48 user nova-compute[75216]: WARNING nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received unexpected event network-vif-plugged-057fe2b6-edae-428a-af80-4dc3475118c6 for instance with vm_state deleted and task_state None.
Nov 02 05:21:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95481abb-719f-4212-9cca-9cfe4b06c87d req-0002f790-d6cf-40b5-af50-c985461b00fe service nova] [instance: 4f7dea1b-7916-4d4e-b0c2-d4e111513f21] Received event network-vif-deleted-057fe2b6-edae-428a-af80-4dc3475118c6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:21:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:03 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bf3440c-094c-4748-ba82-6502decfd65c is timed out.
Nov 02 05:22:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully detached device vdb from instance 0bf3440c-094c-4748-ba82-6502decfd65c from the live domain config.
Nov 02 05:22:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtzBFroQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:22:03 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb823a62-7b85-416d-bae1-f003e68e45ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:22:03 user nova-compute[75216]: No targets found.
Nov 02 05:22:03 user nova-compute[75216]: iSNS:
Nov 02 05:22:03 user nova-compute[75216]: No targets found.
Nov 02 05:22:03 user nova-compute[75216]: STATIC:
Nov 02 05:22:03 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218
Nov 02 05:22:03 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:22:03 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:22:03 user nova-compute[75216]: FIRMWARE:
Nov 02 05:22:03 user nova-compute[75216]: No targets found.
Nov 02 05:22:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:22:03 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:22:03 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871e4f4-0907-4779-ae9d-9f006f6f5b50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1a37aa-705c-4fab-ba18-417385dd631c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 (non-flash)
Nov 02 05:22:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 (non-flash)
Nov 02 05:22:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f460c35f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374503b-7e32-4a4d-ba0c-db76bf24a0c6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0b977-d378-4622-850e-32ba1bee3a33]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d789748-25ae-4926-8435-6b36a461ccde]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8cfa42-6b18-4146-a0a6-5a1439cb0239]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b16d2e6-156e-4393-b93c-c5347129c05f]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51a9de-2508-4a78-bebc-7713bc9a796e]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260]
Nov 02 05:22:03 user nova-compute[75216]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218, portal: 172.16.0.220,3260] successful.
Nov 02 05:22:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa4d4456-9946-4348-bc05-c00c32c27218 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c1cb72-ad7c-4765-a2ad-4792ce7f1d05]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] <== disconnect_volume: return (295ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:22:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:22:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'flavor' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:22:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-31d3363e-a98e-466a-a13f-01f2c38b8589 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:22:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:22:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:22:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:22:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:22:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:22:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:22:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:22:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:22:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:22:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:22:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=24.82067108154297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:22:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:42 user nova-compute[75216]: INFO nova.compute.manager [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Rescuing
Nov 02 05:22:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-bce2434d-89ac-4bba-b115-712edf9bb9b8 req-65d76150-adb4-4d6d-b250-e5cad6c35b95 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bce2434d-89ac-4bba-b115-712edf9bb9b8 req-65d76150-adb4-4d6d-b250-e5cad6c35b95 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bce2434d-89ac-4bba-b115-712edf9bb9b8 req-65d76150-adb4-4d6d-b250-e5cad6c35b95 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bce2434d-89ac-4bba-b115-712edf9bb9b8 req-65d76150-adb4-4d6d-b250-e5cad6c35b95 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-bce2434d-89ac-4bba-b115-712edf9bb9b8 req-65d76150-adb4-4d6d-b250-e5cad6c35b95 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:22:43 user nova-compute[75216]: WARNING nova.compute.manager [req-bce2434d-89ac-4bba-b115-712edf9bb9b8 req-65d76150-adb4-4d6d-b250-e5cad6c35b95 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state active and task_state rescuing.
Nov 02 05:22:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance destroyed successfully.
Nov 02 05:22:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Attempting rescue
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 05:22:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Creating image(s)
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'migration_context' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<649e6f30-7b44-4cfa-8163-75ea92e2d030> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Start _get_guest_xml network_info=[{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:0e:fc:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68d67248-2499-473c-a9cd-909ea99614c1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'resources' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<649e6f30-7b44-4cfa-8163-75ea92e2d030> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'numa_topology' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<649e6f30-7b44-4cfa-8163-75ea92e2d030> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:22:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:22:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<649e6f30-7b44-4cfa-8163-75ea92e2d030> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179035485',display_name='tempest-ServerRescueNegativeTestJSON-server-1179035485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179035485',id=51,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-j7cnv5g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:20:59Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=649e6f30-7b44-4cfa-8163-75ea92e2d030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:0e:fc:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:0e:fc:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'pci_devices' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<649e6f30-7b44-4cfa-8163-75ea92e2d030> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:22:43 user nova-compute[75216]:   <uuid>649e6f30-7b44-4cfa-8163-75ea92e2d030</uuid>
Nov 02 05:22:43 user nova-compute[75216]:   <name>instance-00000033</name>
Nov 02 05:22:43 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:22:43 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:22:43 user nova-compute[75216]:   <metadata>
Nov 02 05:22:43 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:22:43 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:22:43 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1179035485</nova:name>
Nov 02 05:22:43 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:22:43</nova:creationTime>
Nov 02 05:22:43 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:22:43 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:22:43 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:22:43 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:22:43 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:22:43 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:22:43 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:22:43 user nova-compute[75216]:       <nova:owner>
Nov 02 05:22:43 user nova-compute[75216]:         <nova:user uuid="a054457281864930a9803e8ce901dcd0">tempest-ServerRescueNegativeTestJSON-979818861-project-member</nova:user>
Nov 02 05:22:43 user nova-compute[75216]:         <nova:project uuid="89d2dbfd63fb4326ba4d9eeb8bef7992">tempest-ServerRescueNegativeTestJSON-979818861</nova:project>
Nov 02 05:22:43 user nova-compute[75216]:       </nova:owner>
Nov 02 05:22:43 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:22:43 user nova-compute[75216]:       <nova:ports>
Nov 02 05:22:43 user nova-compute[75216]:         <nova:port uuid="e88b951e-365c-4a37-98ee-db33fc9a342c">
Nov 02 05:22:43 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 05:22:43 user nova-compute[75216]:         </nova:port>
Nov 02 05:22:43 user nova-compute[75216]:       </nova:ports>
Nov 02 05:22:43 user nova-compute[75216]:     </nova:instance>
Nov 02 05:22:43 user nova-compute[75216]:   </metadata>
Nov 02 05:22:43 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:22:43 user nova-compute[75216]:     <system>
Nov 02 05:22:43 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:22:43 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:22:43 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:22:43 user nova-compute[75216]:       <entry name="serial">649e6f30-7b44-4cfa-8163-75ea92e2d030</entry>
Nov 02 05:22:43 user nova-compute[75216]:       <entry name="uuid">649e6f30-7b44-4cfa-8163-75ea92e2d030</entry>
Nov 02 05:22:43 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:22:43 user nova-compute[75216]:     </system>
Nov 02 05:22:43 user nova-compute[75216]:   </sysinfo>
Nov 02 05:22:43 user nova-compute[75216]:   <os>
Nov 02 05:22:43 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:22:43 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:22:43 user nova-compute[75216]:   </os>
Nov 02 05:22:43 user nova-compute[75216]:   <features>
Nov 02 05:22:43 user nova-compute[75216]:     <acpi/>
Nov 02 05:22:43 user nova-compute[75216]:     <apic/>
Nov 02 05:22:43 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:22:43 user nova-compute[75216]:   </features>
Nov 02 05:22:43 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:22:43 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:22:43 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:22:43 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:22:43 user nova-compute[75216]:   </clock>
Nov 02 05:22:43 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:22:43 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:22:43 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:22:43 user nova-compute[75216]:   </cpu>
Nov 02 05:22:43 user nova-compute[75216]:   <devices>
Nov 02 05:22:43 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:22:43 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:22:43 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue"/>
Nov 02 05:22:43 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:22:43 user nova-compute[75216]:     </disk>
Nov 02 05:22:43 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:22:43 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:22:43 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk"/>
Nov 02 05:22:43 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 05:22:43 user nova-compute[75216]:     </disk>
Nov 02 05:22:43 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:22:43 user nova-compute[75216]:       <mac address="fa:16:3e:0e:fc:a7"/>
Nov 02 05:22:43 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:22:43 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:22:43 user nova-compute[75216]:       <target dev="tape88b951e-36"/>
Nov 02 05:22:43 user nova-compute[75216]:     </interface>
Nov 02 05:22:43 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:22:43 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/console.log" append="off"/>
Nov 02 05:22:43 user nova-compute[75216]:     </serial>
Nov 02 05:22:43 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:22:43 user nova-compute[75216]:     <video>
Nov 02 05:22:43 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:22:43 user nova-compute[75216]:     </video>
Nov 02 05:22:43 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:22:43 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:22:43 user nova-compute[75216]:     </rng>
Nov 02 05:22:43 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:22:43 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:22:43 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:22:43 user nova-compute[75216]:     </memballoon>
Nov 02 05:22:43 user nova-compute[75216]:   </devices>
Nov 02 05:22:43 user nova-compute[75216]: </domain>
Nov 02 05:22:43 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:22:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance destroyed successfully.
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:22:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No VIF found with MAC fa:16:3e:0e:fc:a7, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-7822737a-5bac-4e42-82e0-15733e117f31 req-969077ad-84c1-442e-812b-96ff27051162 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7822737a-5bac-4e42-82e0-15733e117f31 req-969077ad-84c1-442e-812b-96ff27051162 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7822737a-5bac-4e42-82e0-15733e117f31 req-969077ad-84c1-442e-812b-96ff27051162 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7822737a-5bac-4e42-82e0-15733e117f31 req-969077ad-84c1-442e-812b-96ff27051162 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-7822737a-5bac-4e42-82e0-15733e117f31 req-969077ad-84c1-442e-812b-96ff27051162 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:22:45 user nova-compute[75216]: WARNING nova.compute.manager [req-7822737a-5bac-4e42-82e0-15733e117f31 req-969077ad-84c1-442e-812b-96ff27051162 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state active and task_state rescuing.
Nov 02 05:22:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:22:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:22:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:22:47 user nova-compute[75216]: WARNING nova.compute.manager [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state active and task_state rescuing.
Nov 02 05:22:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:22:47 user nova-compute[75216]: WARNING nova.compute.manager [req-fb6f6da1-174d-4de0-b36b-6fe679b85ee2 req-2e20ce4d-fc02-43b4-a0a0-a836f108aa4c service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state active and task_state rescuing.
Nov 02 05:22:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-33d78b50-a95e-41aa-9bf7-a5ac2a58df32 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:22:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:22:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:23:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:23:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:23:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:23:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=24.857013702392578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 0bf3440c-094c-4748-ba82-6502decfd65c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:23:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:23:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:23:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:23:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:23:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:23:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:23:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:23:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:23:47 user nova-compute[75216]: INFO nova.compute.manager [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Terminating instance
Nov 02 05:23:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95572eb0-163d-4743-8261-c9e04e2ab27d req-0fd0217c-b96f-43c9-b4f8-98c32e355cd1 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-vif-unplugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95572eb0-163d-4743-8261-c9e04e2ab27d req-0fd0217c-b96f-43c9-b4f8-98c32e355cd1 service nova] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95572eb0-163d-4743-8261-c9e04e2ab27d req-0fd0217c-b96f-43c9-b4f8-98c32e355cd1 service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95572eb0-163d-4743-8261-c9e04e2ab27d req-0fd0217c-b96f-43c9-b4f8-98c32e355cd1 service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95572eb0-163d-4743-8261-c9e04e2ab27d req-0fd0217c-b96f-43c9-b4f8-98c32e355cd1 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] No waiting events found dispatching network-vif-unplugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-95572eb0-163d-4743-8261-c9e04e2ab27d req-0fd0217c-b96f-43c9-b4f8-98c32e355cd1 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-vif-unplugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Instance destroyed successfully.
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lazy-loading 'resources' on Instance uuid 0bf3440c-094c-4748-ba82-6502decfd65c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-680841892',display_name='tempest-SnapshotDataIntegrityTests-server-680841892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-680841892',id=48,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYIcsfQ185MxeKTyax5aGCk+2wxKwSgKakDCY4qpvTuaJ+KN8tiFOU9H+Ak2xYKlKQB66n8iAI4jh9U54YFtt1DEqT2JSMXVwIPbnQXQYWgccWDvdXHt8ojsDnPKbBlBQ==',key_name='tempest-keypair-256835962',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:14:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b9eab54566941b3b4cc60a56b149161',ramdisk_id='',reservation_id='r-9e2qd0kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-403700980',owner_user_name='tempest-SnapshotDataIntegrityTests-403700980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:14:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='058db2cf6570427080519cc52bfed93b',uuid=0bf3440c-094c-4748-ba82-6502decfd65c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Converting VIF {"id": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "address": "fa:16:3e:e1:57:3b", "network": {"id": "21f6c571-3800-4bf2-901d-1979a5f766fb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1426260716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9eab54566941b3b4cc60a56b149161", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8bb44b8-d4", "ovs_interfaceid": "e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:3b,bridge_name='br-int',has_traffic_filtering=True,id=e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811,network=Network(21f6c571-3800-4bf2-901d-1979a5f766fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8bb44b8-d4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG os_vif [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:3b,bridge_name='br-int',has_traffic_filtering=True,id=e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811,network=Network(21f6c571-3800-4bf2-901d-1979a5f766fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8bb44b8-d4') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8bb44b8-d4, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f68e84e-2c37-4a57-b4c8-659545269dc4) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:23:48 user nova-compute[75216]: INFO os_vif [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:3b,bridge_name='br-int',has_traffic_filtering=True,id=e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811,network=Network(21f6c571-3800-4bf2-901d-1979a5f766fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8bb44b8-d4')
Nov 02 05:23:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Deleting instance files /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c_del
Nov 02 05:23:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Deletion of /opt/stack/data/nova/instances/0bf3440c-094c-4748-ba82-6502decfd65c_del complete
Nov 02 05:23:48 user nova-compute[75216]: INFO nova.compute.manager [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 05:23:48 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:23:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:23:49 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:23:49 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Took 0.84 seconds to deallocate network for instance.
Nov 02 05:23:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-68074710-2cc4-43fe-a480-6935ac883a8c req-eb694bf7-d803-4037-99ff-823e21ee46e4 service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-vif-deleted-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:23:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:23:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:23:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:23:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:23:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:23:49 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Deleted allocations for instance 0bf3440c-094c-4748-ba82-6502decfd65c
Nov 02 05:23:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0142c992-a6aa-42f2-9947-174958294e43 tempest-SnapshotDataIntegrityTests-403700980 tempest-SnapshotDataIntegrityTests-403700980-project-member] Lock "0bf3440c-094c-4748-ba82-6502decfd65c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.051s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-fed22000-4e8c-4f62-b319-bbd32e2fafb7 req-e4df062b-1040-4bf5-9826-4a15f34421bb service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received event network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fed22000-4e8c-4f62-b319-bbd32e2fafb7 req-e4df062b-1040-4bf5-9826-4a15f34421bb service nova] Acquiring lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fed22000-4e8c-4f62-b319-bbd32e2fafb7 req-e4df062b-1040-4bf5-9826-4a15f34421bb service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fed22000-4e8c-4f62-b319-bbd32e2fafb7 req-e4df062b-1040-4bf5-9826-4a15f34421bb service nova] Lock "0bf3440c-094c-4748-ba82-6502decfd65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-fed22000-4e8c-4f62-b319-bbd32e2fafb7 req-e4df062b-1040-4bf5-9826-4a15f34421bb service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] No waiting events found dispatching network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:23:50 user nova-compute[75216]: WARNING nova.compute.manager [req-fed22000-4e8c-4f62-b319-bbd32e2fafb7 req-e4df062b-1040-4bf5-9826-4a15f34421bb service nova] [instance: 0bf3440c-094c-4748-ba82-6502decfd65c] Received unexpected event network-vif-plugged-e8bb44b8-d4c0-46bb-b1f5-7c79e1c0b811 for instance with vm_state deleted and task_state None.
Nov 02 05:23:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:23:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:23:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:24:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:24:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:24:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:24:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:24:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:24:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:24:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:24:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:24:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:24:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:24:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=24.876144409179688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:24:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:24:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:24:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:24:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:24:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:24:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:24:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:24:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:24:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:24:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:24:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:24:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:24:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:24:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:25:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:25:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:25:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:25:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:25:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:25:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:25:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:25:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:25:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:25:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:25:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:38 user nova-compute[75216]: INFO nova.compute.manager [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Rescuing
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:25:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-421b1d50-9838-48b4-8ab6-aee26133c85c req-9eae9591-794f-4ddf-871c-0ab803a10758 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-421b1d50-9838-48b4-8ab6-aee26133c85c req-9eae9591-794f-4ddf-871c-0ab803a10758 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-421b1d50-9838-48b4-8ab6-aee26133c85c req-9eae9591-794f-4ddf-871c-0ab803a10758 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-421b1d50-9838-48b4-8ab6-aee26133c85c req-9eae9591-794f-4ddf-871c-0ab803a10758 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-421b1d50-9838-48b4-8ab6-aee26133c85c req-9eae9591-794f-4ddf-871c-0ab803a10758 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:40 user nova-compute[75216]: WARNING nova.compute.manager [req-421b1d50-9838-48b4-8ab6-aee26133c85c req-9eae9591-794f-4ddf-871c-0ab803a10758 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance destroyed successfully.
Nov 02 05:25:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:25:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=24.87456512451172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Attempting rescue
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 05:25:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Creating image(s)
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.rescue" returned: 0 in 0.058s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'migration_context' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<9dd925a2-8024-4922-933c-b219cb623a24> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Start _get_guest_xml network_info=[{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:62:78:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68d67248-2499-473c-a9cd-909ea99614c1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'resources' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<9dd925a2-8024-4922-933c-b219cb623a24> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'numa_topology' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<9dd925a2-8024-4922-933c-b219cb623a24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:25:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:25:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<9dd925a2-8024-4922-933c-b219cb623a24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-437711847',display_name='tempest-ServerRescueNegativeTestJSON-server-437711847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-437711847',id=50,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-m4odo907',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:20:59Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=9dd925a2-8024-4922-933c-b219cb623a24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:62:78:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:62:78:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<9dd925a2-8024-4922-933c-b219cb623a24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:25:40 user nova-compute[75216]:   <uuid>9dd925a2-8024-4922-933c-b219cb623a24</uuid>
Nov 02 05:25:40 user nova-compute[75216]:   <name>instance-00000032</name>
Nov 02 05:25:40 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:25:40 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:25:40 user nova-compute[75216]:   <metadata>
Nov 02 05:25:40 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:25:40 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:25:40 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-437711847</nova:name>
Nov 02 05:25:40 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:25:40</nova:creationTime>
Nov 02 05:25:40 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:25:40 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:25:40 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:25:40 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:25:40 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:25:40 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:25:40 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:25:40 user nova-compute[75216]:       <nova:owner>
Nov 02 05:25:40 user nova-compute[75216]:         <nova:user uuid="a054457281864930a9803e8ce901dcd0">tempest-ServerRescueNegativeTestJSON-979818861-project-member</nova:user>
Nov 02 05:25:40 user nova-compute[75216]:         <nova:project uuid="89d2dbfd63fb4326ba4d9eeb8bef7992">tempest-ServerRescueNegativeTestJSON-979818861</nova:project>
Nov 02 05:25:40 user nova-compute[75216]:       </nova:owner>
Nov 02 05:25:40 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:25:40 user nova-compute[75216]:       <nova:ports>
Nov 02 05:25:40 user nova-compute[75216]:         <nova:port uuid="9ac045d0-585a-4a65-880d-1db5d9f63fd7">
Nov 02 05:25:40 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 05:25:40 user nova-compute[75216]:         </nova:port>
Nov 02 05:25:40 user nova-compute[75216]:       </nova:ports>
Nov 02 05:25:40 user nova-compute[75216]:     </nova:instance>
Nov 02 05:25:40 user nova-compute[75216]:   </metadata>
Nov 02 05:25:40 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:25:40 user nova-compute[75216]:     <system>
Nov 02 05:25:40 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:25:40 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:25:40 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:25:40 user nova-compute[75216]:       <entry name="serial">9dd925a2-8024-4922-933c-b219cb623a24</entry>
Nov 02 05:25:40 user nova-compute[75216]:       <entry name="uuid">9dd925a2-8024-4922-933c-b219cb623a24</entry>
Nov 02 05:25:40 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:25:40 user nova-compute[75216]:     </system>
Nov 02 05:25:40 user nova-compute[75216]:   </sysinfo>
Nov 02 05:25:40 user nova-compute[75216]:   <os>
Nov 02 05:25:40 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:25:40 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:25:40 user nova-compute[75216]:   </os>
Nov 02 05:25:40 user nova-compute[75216]:   <features>
Nov 02 05:25:40 user nova-compute[75216]:     <acpi/>
Nov 02 05:25:40 user nova-compute[75216]:     <apic/>
Nov 02 05:25:40 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:25:40 user nova-compute[75216]:   </features>
Nov 02 05:25:40 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:25:40 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:25:40 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:25:40 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:25:40 user nova-compute[75216]:   </clock>
Nov 02 05:25:40 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:25:40 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:25:40 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:25:40 user nova-compute[75216]:   </cpu>
Nov 02 05:25:40 user nova-compute[75216]:   <devices>
Nov 02 05:25:40 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:25:40 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:25:40 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.rescue"/>
Nov 02 05:25:40 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:25:40 user nova-compute[75216]:     </disk>
Nov 02 05:25:40 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:25:40 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:25:40 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk"/>
Nov 02 05:25:40 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 05:25:40 user nova-compute[75216]:     </disk>
Nov 02 05:25:40 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:25:40 user nova-compute[75216]:       <mac address="fa:16:3e:62:78:db"/>
Nov 02 05:25:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:25:40 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:25:40 user nova-compute[75216]:       <target dev="tap9ac045d0-58"/>
Nov 02 05:25:40 user nova-compute[75216]:     </interface>
Nov 02 05:25:40 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:25:40 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/console.log" append="off"/>
Nov 02 05:25:40 user nova-compute[75216]:     </serial>
Nov 02 05:25:40 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:25:40 user nova-compute[75216]:     <video>
Nov 02 05:25:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:25:40 user nova-compute[75216]:     </video>
Nov 02 05:25:40 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:25:40 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:25:40 user nova-compute[75216]:     </rng>
Nov 02 05:25:40 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:25:40 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:25:40 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:25:40 user nova-compute[75216]:     </memballoon>
Nov 02 05:25:40 user nova-compute[75216]:   </devices>
Nov 02 05:25:40 user nova-compute[75216]: </domain>
Nov 02 05:25:40 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:25:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance destroyed successfully.
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:25:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No VIF found with MAC fa:16:3e:62:78:db, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:41 user nova-compute[75216]: WARNING nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:41 user nova-compute[75216]: WARNING nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:41 user nova-compute[75216]: WARNING nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:41 user nova-compute[75216]: WARNING nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:41 user nova-compute[75216]: WARNING nova.compute.manager [req-ee21c27c-aef0-4b3f-a06b-5bd047dbc56f req-49e976dc-5220-4587-990d-5a3ebc9a5905 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:43 user nova-compute[75216]: WARNING nova.compute.manager [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:25:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:25:43 user nova-compute[75216]: WARNING nova.compute.manager [req-2a04f689-96bc-4177-96a1-89cf1dabde97 req-2e92c836-eeca-4e06-85b4-244fdee49f82 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state active and task_state rescuing.
Nov 02 05:25:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-92d0e97e-fd4e-4975-bb7a-da0e73a8959e tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:25:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:25:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:25:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:25:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:26:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:26:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:26:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:26:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=24.872852325439453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:26:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:26:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:26:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:26:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:26:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:26:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:26:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:26:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:26:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:26:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:26:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:27:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:27:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:27:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:27:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:27:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:27:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:27:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:27:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:27:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:30 user nova-compute[75216]: INFO nova.compute.manager [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Unrescuing
Nov 02 05:27:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'flavor' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b0e45d86-51a1-4d84-ab22-bf7997afc7f0 req-5ad440d1-ce41-42ba-92e7-de4ee538a27e service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:27:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0e45d86-51a1-4d84-ab22-bf7997afc7f0 req-5ad440d1-ce41-42ba-92e7-de4ee538a27e service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:27:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0e45d86-51a1-4d84-ab22-bf7997afc7f0 req-5ad440d1-ce41-42ba-92e7-de4ee538a27e service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:27:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0e45d86-51a1-4d84-ab22-bf7997afc7f0 req-5ad440d1-ce41-42ba-92e7-de4ee538a27e service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:27:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b0e45d86-51a1-4d84-ab22-bf7997afc7f0 req-5ad440d1-ce41-42ba-92e7-de4ee538a27e service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:27:31 user nova-compute[75216]: WARNING nova.compute.manager [req-b0e45d86-51a1-4d84-ab22-bf7997afc7f0 req-5ad440d1-ce41-42ba-92e7-de4ee538a27e service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 05:27:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance destroyed successfully.
Nov 02 05:27:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:27:33 user nova-compute[75216]: WARNING nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 05:27:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:27:33 user nova-compute[75216]: WARNING nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 05:27:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:27:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:27:33 user nova-compute[75216]: WARNING nova.compute.manager [req-7dc762b0-a871-4819-97df-d46ab0d16cff req-7e130ac3-d09b-4f63-b65a-852113ddf888 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 05:27:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cf4774da-855d-4b39-9a16-c1e015bc18d6 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:27:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:27:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:27:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:27:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:27:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=24.871917724609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:27:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:27:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:27:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:27:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:27:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:27:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:27:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:27:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:27:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:27:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:27:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:27:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:27:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:28:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:28:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:28:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:28:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:28:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:28:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:28:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:28:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:28:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8878MB free_disk=24.87106704711914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:28:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:28:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:28:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:28:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:28:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:28:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:28:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:28:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:28:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:28:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:28:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:28:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:28:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:28:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:28:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:28:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:28:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:28:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:29:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:29:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:29:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:29:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:29:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:29:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:29:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:29:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:29:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 05:29:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 05:29:28 user nova-compute[75216]: INFO nova.compute.claims [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Claim successful on node user
Nov 02 05:29:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 05:29:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.policy [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a054457281864930a9803e8ce901dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d2dbfd63fb4326ba4d9eeb8bef7992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 05:29:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Creating image(s)
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk 1073741824" returned: 0 in 0.048s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 05:29:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Successfully created port: ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Cannot resize image /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Ensure instance console log exists: /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Successfully updated port: ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing instance network info cache due to event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:29:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance network_info: |[{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Start _get_guest_xml network_info=[{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '68d67248-2499-473c-a9cd-909ea99614c1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:29:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:29:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1049006202',display_name='tempest-ServerRescueNegativeTestJSON-server-1049006202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1049006202',id=52,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFnIhdyc0uGcEQj1l07u1y8V4bjqqDdA6kNka0ESo/03OnDcxuoaBhIb0qOoBdclelr/27nZ+39okv/UHA9ZPVuBvFXB95Y4J4YmSrjoAZsedd11TllSgv3rIP5quPfsQ==',key_name='tempest-keypair-1914023883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-d9zzraj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a054457281864930a9803e8ce901dcd0',uuid=68c1ec23-dbbc-4015-af77-e9116595d8ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'pci_devices' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:29:31 user nova-compute[75216]:   <uuid>68c1ec23-dbbc-4015-af77-e9116595d8ab</uuid>
Nov 02 05:29:31 user nova-compute[75216]:   <name>instance-00000034</name>
Nov 02 05:29:31 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:29:31 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:29:31 user nova-compute[75216]:   <metadata>
Nov 02 05:29:31 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:29:31 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:29:31 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1049006202</nova:name>
Nov 02 05:29:31 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:29:31</nova:creationTime>
Nov 02 05:29:31 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:29:31 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:29:31 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:29:31 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:29:31 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:29:31 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:29:31 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:29:31 user nova-compute[75216]:       <nova:owner>
Nov 02 05:29:31 user nova-compute[75216]:         <nova:user uuid="a054457281864930a9803e8ce901dcd0">tempest-ServerRescueNegativeTestJSON-979818861-project-member</nova:user>
Nov 02 05:29:31 user nova-compute[75216]:         <nova:project uuid="89d2dbfd63fb4326ba4d9eeb8bef7992">tempest-ServerRescueNegativeTestJSON-979818861</nova:project>
Nov 02 05:29:31 user nova-compute[75216]:       </nova:owner>
Nov 02 05:29:31 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:29:31 user nova-compute[75216]:       <nova:ports>
Nov 02 05:29:31 user nova-compute[75216]:         <nova:port uuid="ae3a4027-bf5b-457a-b0b1-bf66381d6c0f">
Nov 02 05:29:31 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 05:29:31 user nova-compute[75216]:         </nova:port>
Nov 02 05:29:31 user nova-compute[75216]:       </nova:ports>
Nov 02 05:29:31 user nova-compute[75216]:     </nova:instance>
Nov 02 05:29:31 user nova-compute[75216]:   </metadata>
Nov 02 05:29:31 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:29:31 user nova-compute[75216]:     <system>
Nov 02 05:29:31 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:29:31 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:29:31 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:29:31 user nova-compute[75216]:       <entry name="serial">68c1ec23-dbbc-4015-af77-e9116595d8ab</entry>
Nov 02 05:29:31 user nova-compute[75216]:       <entry name="uuid">68c1ec23-dbbc-4015-af77-e9116595d8ab</entry>
Nov 02 05:29:31 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:29:31 user nova-compute[75216]:     </system>
Nov 02 05:29:31 user nova-compute[75216]:   </sysinfo>
Nov 02 05:29:31 user nova-compute[75216]:   <os>
Nov 02 05:29:31 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:29:31 user nova-compute[75216]:     <boot dev="hd"/>
Nov 02 05:29:31 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:29:31 user nova-compute[75216]:   </os>
Nov 02 05:29:31 user nova-compute[75216]:   <features>
Nov 02 05:29:31 user nova-compute[75216]:     <acpi/>
Nov 02 05:29:31 user nova-compute[75216]:     <apic/>
Nov 02 05:29:31 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:29:31 user nova-compute[75216]:   </features>
Nov 02 05:29:31 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:29:31 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:29:31 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:29:31 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:29:31 user nova-compute[75216]:   </clock>
Nov 02 05:29:31 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:29:31 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:29:31 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:29:31 user nova-compute[75216]:   </cpu>
Nov 02 05:29:31 user nova-compute[75216]:   <devices>
Nov 02 05:29:31 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:29:31 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:29:31 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk"/>
Nov 02 05:29:31 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:29:31 user nova-compute[75216]:     </disk>
Nov 02 05:29:31 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:29:31 user nova-compute[75216]:       <mac address="fa:16:3e:b0:53:bb"/>
Nov 02 05:29:31 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:29:31 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:29:31 user nova-compute[75216]:       <target dev="tapae3a4027-bf"/>
Nov 02 05:29:31 user nova-compute[75216]:     </interface>
Nov 02 05:29:31 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:29:31 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/console.log" append="off"/>
Nov 02 05:29:31 user nova-compute[75216]:     </serial>
Nov 02 05:29:31 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:29:31 user nova-compute[75216]:     <video>
Nov 02 05:29:31 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:29:31 user nova-compute[75216]:     </video>
Nov 02 05:29:31 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:29:31 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:29:31 user nova-compute[75216]:     </rng>
Nov 02 05:29:31 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:29:31 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:29:31 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:29:31 user nova-compute[75216]:     </memballoon>
Nov 02 05:29:31 user nova-compute[75216]:   </devices>
Nov 02 05:29:31 user nova-compute[75216]: </domain>
Nov 02 05:29:31 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1049006202',display_name='tempest-ServerRescueNegativeTestJSON-server-1049006202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1049006202',id=52,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFnIhdyc0uGcEQj1l07u1y8V4bjqqDdA6kNka0ESo/03OnDcxuoaBhIb0qOoBdclelr/27nZ+39okv/UHA9ZPVuBvFXB95Y4J4YmSrjoAZsedd11TllSgv3rIP5quPfsQ==',key_name='tempest-keypair-1914023883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-d9zzraj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a054457281864930a9803e8ce901dcd0',uuid=68c1ec23-dbbc-4015-af77-e9116595d8ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG os_vif [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e0443a2-ca16-5300-837c-3c4b1ba95e05', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae3a4027-bf, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae3a4027-bf, col_values=(('qos', UUID('4b547f83-4230-498d-8809-754d0e55dca7')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae3a4027-bf, col_values=(('external_ids', {'iface-id': 'ae3a4027-bf5b-457a-b0b1-bf66381d6c0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:53:bb', 'vm-uuid': '68c1ec23-dbbc-4015-af77-e9116595d8ab'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:31 user nova-compute[75216]: INFO os_vif [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf')
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No VIF found with MAC fa:16:3e:b0:53:bb, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updated VIF entry in instance network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:29:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d8265ad8-fc8f-4946-903a-33bd6e7110be req-04cc7869-b758-41c1-9afd-6a4c98b8e561 service nova] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-38194071-7447-4eac-b020-fbd29b312dc8 req-8369acdf-c3df-4ac0-b08f-dc0bb61c8c03 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38194071-7447-4eac-b020-fbd29b312dc8 req-8369acdf-c3df-4ac0-b08f-dc0bb61c8c03 service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38194071-7447-4eac-b020-fbd29b312dc8 req-8369acdf-c3df-4ac0-b08f-dc0bb61c8c03 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38194071-7447-4eac-b020-fbd29b312dc8 req-8369acdf-c3df-4ac0-b08f-dc0bb61c8c03 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-38194071-7447-4eac-b020-fbd29b312dc8 req-8369acdf-c3df-4ac0-b08f-dc0bb61c8c03 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:29:32 user nova-compute[75216]: WARNING nova.compute.manager [req-38194071-7447-4eac-b020-fbd29b312dc8 req-8369acdf-c3df-4ac0-b08f-dc0bb61c8c03 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state building and task_state spawning.
Nov 02 05:29:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 05:29:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance spawned successfully.
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 05:29:34 user nova-compute[75216]: INFO nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-05c3572c-cbc9-41cd-9f3b-991e07cadc37 req-d881154e-9a80-4550-b336-3fca0b39889a service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05c3572c-cbc9-41cd-9f3b-991e07cadc37 req-d881154e-9a80-4550-b336-3fca0b39889a service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05c3572c-cbc9-41cd-9f3b-991e07cadc37 req-d881154e-9a80-4550-b336-3fca0b39889a service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-05c3572c-cbc9-41cd-9f3b-991e07cadc37 req-d881154e-9a80-4550-b336-3fca0b39889a service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-05c3572c-cbc9-41cd-9f3b-991e07cadc37 req-d881154e-9a80-4550-b336-3fca0b39889a service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:29:34 user nova-compute[75216]: WARNING nova.compute.manager [req-05c3572c-cbc9-41cd-9f3b-991e07cadc37 req-d881154e-9a80-4550-b336-3fca0b39889a service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state building and task_state spawning.
Nov 02 05:29:34 user nova-compute[75216]: INFO nova.compute.manager [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Took 5.93 seconds to build instance.
Nov 02 05:29:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a4256f41-62bb-4cb4-962c-a6e2d80f8079 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.021s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:29:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:29:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:29:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.869224548339844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 68c1ec23-dbbc-4015-af77-e9116595d8ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:29:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:29:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:29:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:29:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:29:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:29:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:29:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:29:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:29:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:29:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:29:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:29:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:29:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:30:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:30:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:30:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:30:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:30:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:30:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:30:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:30:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:30:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Triggering sync for uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "9dd925a2-8024-4922-933c-b219cb623a24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "9dd925a2-8024-4922-933c-b219cb623a24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:30:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:30:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:30:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:30:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:30:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:30:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:30:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:30:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:30:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:30:47 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:30:47 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=24.840782165527344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 68c1ec23-dbbc-4015-af77-e9116595d8ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:30:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:30:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:30:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:30:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:30:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:30:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:30:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:30:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:30:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:30:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:30:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:30:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:30:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:31:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:31:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:31:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:31:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:31:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:31:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:31:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing instance network info cache due to event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:31:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:31:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:31:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'flavor' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:20 user nova-compute[75216]: INFO nova.compute.manager [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Attaching volume 16b868a9-5590-4e8c-b121-ffd7f773327d to /dev/vdb
Nov 02 05:31:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updated VIF entry in instance network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-093e3244-a183-4984-bc80-36e0784fb70d req-ce2e716a-193b-4d05-ba70-c51c9d941554 service nova] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG os_brick.utils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c010134c-4aad-4f99-b577-c860c4e32c50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a0d9a0583b94\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df705ff-3b82-4df0-9c1d-cf1be10dbaa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8709bbcb-48f6-40e6-84b8-dbe6a64efdad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a696e67-f865-417e-8d38-5bf0cfd3d601]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 05:31:20 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 05:31:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a7df2-e2de-47f2-8c8e-c8916102cd64]: (4, '') {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG os_brick.utils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a0d9a0583b94', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:31:20 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating existing volume attachment record: 309522a0-66a5-4002-bfdc-b79db94a8cf3 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 05:31:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:31:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:31:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:31:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:31:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:31:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:31:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSirLchK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:31:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:31:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:31:48 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bdb613-17b7-4f5e-8026-d11c776dfa19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 05:31:48 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --interface default --op new {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e9a0db-aba1-4183-a18c-472bc2c0df40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d] added\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d] added
Nov 02 05:31:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c2a49-c724-4d9c-91f4-38d685a7d2b8]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f110a77-e0c1-4c53-97a9-e067f2aaec4c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSirLchK {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSirLchK" returned: 0 in 0.028s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d4631-decb-4ce1-a3c4-a2265e36260c]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSirLchK'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a810812-dc58-4178-8d1a-76f8bb6171db]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d9587-029b-4f8c-8eac-ba071d1a48de]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:31:48 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 05:31:48 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:31:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 05:31:48 user nova-compute[75216]: 
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --login {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a05a89-baee-44ba-98f3-edd18e8abe95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260]
Nov 02 05:31:48 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260] successful.
Nov 02 05:31:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7247d696-fe04-46f7-83d3-dfcb8daaa545]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9309a1-9ad9-4c87-9d0b-f5974d0fc56c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d (non-flash)
Nov 02 05:31:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d (non-flash)
Nov 02 05:31:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db66bfb-6b12-403b-9560-d95de1b268ec]: (4, ('- - 0', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSirLchK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:31:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=24.839954376220703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 68c1ec23-dbbc-4015-af77-e9116595d8ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23465323432653537', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465323432653537', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'flavor' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 05:31:49 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:31:49 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:31:49 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:31:49 user nova-compute[75216]:   <serial>16b868a9-5590-4e8c-b121-ffd7f773327d</serial>
Nov 02 05:31:49 user nova-compute[75216]: </disk>
Nov 02 05:31:49 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 05:31:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:31:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:31:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No VIF found with MAC fa:16:3e:b0:53:bb, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:31:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6524242d-8f2d-4adc-9e3b-b9d299d800dd tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:51 user nova-compute[75216]: INFO nova.compute.manager [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Rescuing
Nov 02 05:31:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:31:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:31:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-96bfe562-a5bd-4cfe-88e0-fcfaadc2f4bf req-bde524f5-8ee6-4d5d-88e7-b442609f3234 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96bfe562-a5bd-4cfe-88e0-fcfaadc2f4bf req-bde524f5-8ee6-4d5d-88e7-b442609f3234 service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96bfe562-a5bd-4cfe-88e0-fcfaadc2f4bf req-bde524f5-8ee6-4d5d-88e7-b442609f3234 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96bfe562-a5bd-4cfe-88e0-fcfaadc2f4bf req-bde524f5-8ee6-4d5d-88e7-b442609f3234 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-96bfe562-a5bd-4cfe-88e0-fcfaadc2f4bf req-bde524f5-8ee6-4d5d-88e7-b442609f3234 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:31:52 user nova-compute[75216]: WARNING nova.compute.manager [req-96bfe562-a5bd-4cfe-88e0-fcfaadc2f4bf req-bde524f5-8ee6-4d5d-88e7-b442609f3234 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state active and task_state rescuing.
Nov 02 05:31:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance destroyed successfully.
Nov 02 05:31:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Attempting rescue
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 05:31:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Creating image(s)
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec --force-share --output=json" returned: 0 in 0.251s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/498230a8c15b3522b23e57c4c66109c7b4a60fec,backing_fmt=raw /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.rescue" returned: 0 in 0.049s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "498230a8c15b3522b23e57c4c66109c7b4a60fec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'migration_context' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<68c1ec23-dbbc-4015-af77-e9116595d8ab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Start _get_guest_xml network_info=[{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:b0:53:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68d67248-2499-473c-a9cd-909ea99614c1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'resources' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<68c1ec23-dbbc-4015-af77-e9116595d8ab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'numa_topology' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<68c1ec23-dbbc-4015-af77-e9116595d8ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:31:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:31:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T04:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T04:39:22Z,direct_url=<?>,disk_format='qcow2',id=68d67248-2499-473c-a9cd-909ea99614c1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='52eb3774d9184a69aef51b2780a0aa5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T04:39:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<68c1ec23-dbbc-4015-af77-e9116595d8ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1049006202',display_name='tempest-ServerRescueNegativeTestJSON-server-1049006202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1049006202',id=52,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFnIhdyc0uGcEQj1l07u1y8V4bjqqDdA6kNka0ESo/03OnDcxuoaBhIb0qOoBdclelr/27nZ+39okv/UHA9ZPVuBvFXB95Y4J4YmSrjoAZsedd11TllSgv3rIP5quPfsQ==',key_name='tempest-keypair-1914023883',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:29:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-d9zzraj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T05:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a054457281864930a9803e8ce901dcd0',uuid=68c1ec23-dbbc-4015-af77-e9116595d8ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:b0:53:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "vif_mac": "fa:16:3e:b0:53:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'pci_devices' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Object Instance<68c1ec23-dbbc-4015-af77-e9116595d8ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] End _get_guest_xml xml=<domain type="kvm">
Nov 02 05:31:53 user nova-compute[75216]:   <uuid>68c1ec23-dbbc-4015-af77-e9116595d8ab</uuid>
Nov 02 05:31:53 user nova-compute[75216]:   <name>instance-00000034</name>
Nov 02 05:31:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 02 05:31:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 02 05:31:53 user nova-compute[75216]:   <metadata>
Nov 02 05:31:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 05:31:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 02 05:31:53 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1049006202</nova:name>
Nov 02 05:31:53 user nova-compute[75216]:       <nova:creationTime>2023-11-02 05:31:53</nova:creationTime>
Nov 02 05:31:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 02 05:31:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 02 05:31:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 02 05:31:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 02 05:31:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 05:31:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 02 05:31:53 user nova-compute[75216]:       </nova:flavor>
Nov 02 05:31:53 user nova-compute[75216]:       <nova:owner>
Nov 02 05:31:53 user nova-compute[75216]:         <nova:user uuid="a054457281864930a9803e8ce901dcd0">tempest-ServerRescueNegativeTestJSON-979818861-project-member</nova:user>
Nov 02 05:31:53 user nova-compute[75216]:         <nova:project uuid="89d2dbfd63fb4326ba4d9eeb8bef7992">tempest-ServerRescueNegativeTestJSON-979818861</nova:project>
Nov 02 05:31:53 user nova-compute[75216]:       </nova:owner>
Nov 02 05:31:53 user nova-compute[75216]:       <nova:root type="image" uuid="68d67248-2499-473c-a9cd-909ea99614c1"/>
Nov 02 05:31:53 user nova-compute[75216]:       <nova:ports>
Nov 02 05:31:53 user nova-compute[75216]:         <nova:port uuid="ae3a4027-bf5b-457a-b0b1-bf66381d6c0f">
Nov 02 05:31:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 05:31:53 user nova-compute[75216]:         </nova:port>
Nov 02 05:31:53 user nova-compute[75216]:       </nova:ports>
Nov 02 05:31:53 user nova-compute[75216]:     </nova:instance>
Nov 02 05:31:53 user nova-compute[75216]:   </metadata>
Nov 02 05:31:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 02 05:31:53 user nova-compute[75216]:     <system>
Nov 02 05:31:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 05:31:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 02 05:31:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 02 05:31:53 user nova-compute[75216]:       <entry name="serial">68c1ec23-dbbc-4015-af77-e9116595d8ab</entry>
Nov 02 05:31:53 user nova-compute[75216]:       <entry name="uuid">68c1ec23-dbbc-4015-af77-e9116595d8ab</entry>
Nov 02 05:31:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 02 05:31:53 user nova-compute[75216]:     </system>
Nov 02 05:31:53 user nova-compute[75216]:   </sysinfo>
Nov 02 05:31:53 user nova-compute[75216]:   <os>
Nov 02 05:31:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 05:31:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 02 05:31:53 user nova-compute[75216]:   </os>
Nov 02 05:31:53 user nova-compute[75216]:   <features>
Nov 02 05:31:53 user nova-compute[75216]:     <acpi/>
Nov 02 05:31:53 user nova-compute[75216]:     <apic/>
Nov 02 05:31:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 02 05:31:53 user nova-compute[75216]:   </features>
Nov 02 05:31:53 user nova-compute[75216]:   <clock offset="utc">
Nov 02 05:31:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 05:31:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 05:31:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 02 05:31:53 user nova-compute[75216]:   </clock>
Nov 02 05:31:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 02 05:31:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 02 05:31:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 05:31:53 user nova-compute[75216]:   </cpu>
Nov 02 05:31:53 user nova-compute[75216]:   <devices>
Nov 02 05:31:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:31:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:31:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.rescue"/>
Nov 02 05:31:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 02 05:31:53 user nova-compute[75216]:     </disk>
Nov 02 05:31:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 02 05:31:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 05:31:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk"/>
Nov 02 05:31:53 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 02 05:31:53 user nova-compute[75216]:     </disk>
Nov 02 05:31:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 02 05:31:53 user nova-compute[75216]:       <mac address="fa:16:3e:b0:53:bb"/>
Nov 02 05:31:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:31:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 02 05:31:53 user nova-compute[75216]:       <target dev="tapae3a4027-bf"/>
Nov 02 05:31:53 user nova-compute[75216]:     </interface>
Nov 02 05:31:53 user nova-compute[75216]:     <serial type="pty">
Nov 02 05:31:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/console.log" append="off"/>
Nov 02 05:31:53 user nova-compute[75216]:     </serial>
Nov 02 05:31:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 05:31:53 user nova-compute[75216]:     <video>
Nov 02 05:31:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 02 05:31:53 user nova-compute[75216]:     </video>
Nov 02 05:31:53 user nova-compute[75216]:     <rng model="virtio">
Nov 02 05:31:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 02 05:31:53 user nova-compute[75216]:     </rng>
Nov 02 05:31:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 02 05:31:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 02 05:31:53 user nova-compute[75216]:       <stats period="10"/>
Nov 02 05:31:53 user nova-compute[75216]:     </memballoon>
Nov 02 05:31:53 user nova-compute[75216]:   </devices>
Nov 02 05:31:53 user nova-compute[75216]: </domain>
Nov 02 05:31:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 05:31:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance destroyed successfully.
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 05:31:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] No VIF found with MAC fa:16:3e:b0:53:bb, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-5fdfd6d7-8701-4a49-9cb8-798acb09ae16 req-72c783b8-5c5c-45e2-a651-db8b700cbbd0 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5fdfd6d7-8701-4a49-9cb8-798acb09ae16 req-72c783b8-5c5c-45e2-a651-db8b700cbbd0 service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5fdfd6d7-8701-4a49-9cb8-798acb09ae16 req-72c783b8-5c5c-45e2-a651-db8b700cbbd0 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5fdfd6d7-8701-4a49-9cb8-798acb09ae16 req-72c783b8-5c5c-45e2-a651-db8b700cbbd0 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-5fdfd6d7-8701-4a49-9cb8-798acb09ae16 req-72c783b8-5c5c-45e2-a651-db8b700cbbd0 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:31:54 user nova-compute[75216]: WARNING nova.compute.manager [req-5fdfd6d7-8701-4a49-9cb8-798acb09ae16 req-72c783b8-5c5c-45e2-a651-db8b700cbbd0 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state active and task_state rescuing.
Nov 02 05:31:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:31:56 user nova-compute[75216]: WARNING nova.compute.manager [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state active and task_state rescuing.
Nov 02 05:31:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:31:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:31:56 user nova-compute[75216]: WARNING nova.compute.manager [req-43c2ebee-7bd2-4bf1-8d2b-2f6df2b026eb req-b0d86255-1710-4dc7-beb7-d71f2aed93c1 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state active and task_state rescuing.
Nov 02 05:31:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d0ff163a-a545-4ee8-8c7b-9a989a85e546 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:31:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:31:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:32:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:32:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:32:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:32:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:32:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=24.838172912597656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 68c1ec23-dbbc-4015-af77-e9116595d8ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:32:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:32:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:32:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:32:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:32:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:32:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:32:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:32:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:32:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:32:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:32:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:33:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:33:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:33:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:33:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:33:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:33:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:42 user nova-compute[75216]: INFO nova.compute.manager [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Unrescuing
Nov 02 05:33:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:33:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:33:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'flavor' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-8b1ebe62-3081-4834-9b22-33616d62cdd0 req-bb0b8464-51aa-44c5-9c6b-5ee09fd789b6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8b1ebe62-3081-4834-9b22-33616d62cdd0 req-bb0b8464-51aa-44c5-9c6b-5ee09fd789b6 service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8b1ebe62-3081-4834-9b22-33616d62cdd0 req-bb0b8464-51aa-44c5-9c6b-5ee09fd789b6 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8b1ebe62-3081-4834-9b22-33616d62cdd0 req-bb0b8464-51aa-44c5-9c6b-5ee09fd789b6 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-8b1ebe62-3081-4834-9b22-33616d62cdd0 req-bb0b8464-51aa-44c5-9c6b-5ee09fd789b6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:33:43 user nova-compute[75216]: WARNING nova.compute.manager [req-8b1ebe62-3081-4834-9b22-33616d62cdd0 req-bb0b8464-51aa-44c5-9c6b-5ee09fd789b6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state rescued and task_state unrescuing.
Nov 02 05:33:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance destroyed successfully.
Nov 02 05:33:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:33:45 user nova-compute[75216]: WARNING nova.compute.manager [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state rescued and task_state unrescuing.
Nov 02 05:33:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:33:45 user nova-compute[75216]: WARNING nova.compute.manager [req-a634d9a3-a0ec-4b26-96ca-2abdef578579 req-67b5f289-a516-42f9-b524-0d3e41877a8e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state rescued and task_state unrescuing.
Nov 02 05:33:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2b13e9b9-571d-496a-a6c4-849bae92aa1f tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5974f1b0-6e8d-46b5-a27b-f197a6c0d31a req-80b7950b-7165-4e5c-9af3-d5c13bfe66e0 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5974f1b0-6e8d-46b5-a27b-f197a6c0d31a req-80b7950b-7165-4e5c-9af3-d5c13bfe66e0 service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5974f1b0-6e8d-46b5-a27b-f197a6c0d31a req-80b7950b-7165-4e5c-9af3-d5c13bfe66e0 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5974f1b0-6e8d-46b5-a27b-f197a6c0d31a req-80b7950b-7165-4e5c-9af3-d5c13bfe66e0 service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:33:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-5974f1b0-6e8d-46b5-a27b-f197a6c0d31a req-80b7950b-7165-4e5c-9af3-d5c13bfe66e0 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:33:47 user nova-compute[75216]: WARNING nova.compute.manager [req-5974f1b0-6e8d-46b5-a27b-f197a6c0d31a req-80b7950b-7165-4e5c-9af3-d5c13bfe66e0 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state active and task_state None.
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:33:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:33:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=24.837203979492188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 68c1ec23-dbbc-4015-af77-e9116595d8ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:33:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:33:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:33:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:33:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:33:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:33:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:33:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:33:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:34:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:34:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:34:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:34:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:34:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 05:34:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:34:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=24.836429595947266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 68c1ec23-dbbc-4015-af77-e9116595d8ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:34:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:34:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [{"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-649e6f30-7b44-4cfa-8163-75ea92e2d030" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:34:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:34:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:35:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:35:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:35:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:35:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:35:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:35:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:35:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:35:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing instance network info cache due to event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:35:34 user nova-compute[75216]: INFO nova.compute.manager [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Detaching volume 16b868a9-5590-4e8c-b121-ffd7f773327d
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updated VIF entry in instance network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-97a7221b-5091-4581-8998-fd7f972d6653 req-e349c632-217c-477a-8b32-a590c350a45b service nova] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:35:34 user nova-compute[75216]: INFO nova.virt.block_device [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Attempting to driver detach volume 16b868a9-5590-4e8c-b121-ffd7f773327d from mountpoint /dev/vdb
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Attempting to detach device vdb from instance 68c1ec23-dbbc-4015-af77-e9116595d8ab from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:35:34 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:35:34 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:35:34 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:35:34 user nova-compute[75216]:   <serial>16b868a9-5590-4e8c-b121-ffd7f773327d</serial>
Nov 02 05:35:34 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:35:34 user nova-compute[75216]: </disk>
Nov 02 05:35:34 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:35:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully detached device vdb from instance 68c1ec23-dbbc-4015-af77-e9116595d8ab from the persistent domain config.
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68c1ec23-dbbc-4015-af77-e9116595d8ab from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 05:35:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 05:35:34 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 05:35:34 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 02 05:35:34 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 02 05:35:34 user nova-compute[75216]:   <serial>16b868a9-5590-4e8c-b121-ffd7f773327d</serial>
Nov 02 05:35:34 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 05:35:34 user nova-compute[75216]: </disk>
Nov 02 05:35:34 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 05:35:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing instance network info cache due to event network-changed-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Refreshing network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updated VIF entry in instance network info cache for port ae3a4027-bf5b-457a-b0b1-bf66381d6c0f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:35:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64f7528a-8940-4bc2-9e9f-4650865fbaeb req-02428c51-63f7-412b-8372-4980152709f6 service nova] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:35:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:35:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:35:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=24.835739135742188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 68c1ec23-dbbc-4015-af77-e9116595d8ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:35:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:35:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68c1ec23-dbbc-4015-af77-e9116595d8ab is timed out.
Nov 02 05:35:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully detached device vdb from instance 68c1ec23-dbbc-4015-af77-e9116595d8ab from the live domain config.
Nov 02 05:35:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f46043a1330>, {'target_iqn': 'iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSirLchK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 05:35:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[66258227-6a9b-477e-a7d0-62498e880e73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 05:35:55 user nova-compute[75216]: No targets found.
Nov 02 05:35:55 user nova-compute[75216]: iSNS:
Nov 02 05:35:55 user nova-compute[75216]: No targets found.
Nov 02 05:35:55 user nova-compute[75216]: STATIC:
Nov 02 05:35:55 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d
Nov 02 05:35:55 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 02 05:35:55 user nova-compute[75216]:                 Iface Name: default
Nov 02 05:35:55 user nova-compute[75216]: FIRMWARE:
Nov 02 05:35:55 user nova-compute[75216]: No targets found.
Nov 02 05:35:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 05:35:55 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 05:35:55 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e54be0-49e9-40fb-ab98-7a57d7fd6915]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d54e83d-9683-4280-8b5c-a41f318f3d54]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d (non-flash)\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d (non-flash)
Nov 02 05:35:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d (non-flash)
Nov 02 05:35:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f45ec5a0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740241b-016a-4dfc-a5ac-3014d8c268eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a382d9b-15d9-47e5-b609-b1462cc8ea74]: (4, ('ok\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9645904f-5e6f-46a0-a198-7dc043f73911]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d372dedb-f987-42ce-8710-57758612d0ff]: (4, ('1', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfbc2c4-dc3c-4ee4-adea-046828c605d5]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --logout {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d782fd6-3247-4c91-8a80-6a2f0eaba1cb]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260]
Nov 02 05:35:55 user nova-compute[75216]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d, portal: 172.16.0.220,3260] successful.
Nov 02 05:35:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op delete {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16b868a9-5590-4e8c-b121-ffd7f773327d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86414) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7851e0-ccf8-4154-8a19-644229276d43]: (4, ('', '')) {{(pid=86414) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] <== disconnect_volume: return (311ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 05:35:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'flavor' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:35:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-549a9e72-60ab-4bb1-96d5-37633dc6f587 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.771s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:35:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:35:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:35:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:35:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:35:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:35:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:35:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [{"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:35:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-68c1ec23-dbbc-4015-af77-e9116595d8ab" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:35:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:35:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:36:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:36:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:36:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:36:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:36:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:36:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:36:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:36:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:36:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:36:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:36:25 user nova-compute[75216]: INFO nova.compute.manager [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Terminating instance
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-2743b479-ae7b-4c7b-acba-6e69f43d4e24 req-5db699cc-c19e-42d2-a910-19a9e25c743d service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2743b479-ae7b-4c7b-acba-6e69f43d4e24 req-5db699cc-c19e-42d2-a910-19a9e25c743d service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2743b479-ae7b-4c7b-acba-6e69f43d4e24 req-5db699cc-c19e-42d2-a910-19a9e25c743d service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2743b479-ae7b-4c7b-acba-6e69f43d4e24 req-5db699cc-c19e-42d2-a910-19a9e25c743d service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-2743b479-ae7b-4c7b-acba-6e69f43d4e24 req-5db699cc-c19e-42d2-a910-19a9e25c743d service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-2743b479-ae7b-4c7b-acba-6e69f43d4e24 req-5db699cc-c19e-42d2-a910-19a9e25c743d service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-unplugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Instance destroyed successfully.
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'resources' on Instance uuid 68c1ec23-dbbc-4015-af77-e9116595d8ab {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1049006202',display_name='tempest-ServerRescueNegativeTestJSON-server-1049006202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1049006202',id=52,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFnIhdyc0uGcEQj1l07u1y8V4bjqqDdA6kNka0ESo/03OnDcxuoaBhIb0qOoBdclelr/27nZ+39okv/UHA9ZPVuBvFXB95Y4J4YmSrjoAZsedd11TllSgv3rIP5quPfsQ==',key_name='tempest-keypair-1914023883',keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-d9zzraj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a054457281864930a9803e8ce901dcd0',uuid=68c1ec23-dbbc-4015-af77-e9116595d8ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "address": "fa:16:3e:b0:53:bb", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae3a4027-bf", "ovs_interfaceid": "ae3a4027-bf5b-457a-b0b1-bf66381d6c0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG os_vif [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae3a4027-bf, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b547f83-4230-498d-8809-754d0e55dca7) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:25 user nova-compute[75216]: INFO os_vif [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:53:bb,bridge_name='br-int',has_traffic_filtering=True,id=ae3a4027-bf5b-457a-b0b1-bf66381d6c0f,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae3a4027-bf')
Nov 02 05:36:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Deleting instance files /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab_del
Nov 02 05:36:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Deletion of /opt/stack/data/nova/instances/68c1ec23-dbbc-4015-af77-e9116595d8ab_del complete
Nov 02 05:36:25 user nova-compute[75216]: INFO nova.compute.manager [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 02 05:36:25 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:36:25 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:36:26 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:36:26 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Took 1.10 seconds to deallocate network for instance.
Nov 02 05:36:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2c8f3-49ed-4442-90b2-2c050a496160 req-d42a08ae-d07f-45e2-9898-35630cec756f service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-deleted-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:36:27 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Deleted allocations for instance 68c1ec23-dbbc-4015-af77-e9116595d8ab
Nov 02 05:36:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-498b2cd9-e231-4edf-be22-2c30383a1620 tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-ecc58d41-eba7-4365-804a-9914533c8295 req-b0d00a43-987e-48f6-8532-19b4e169f03e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ecc58d41-eba7-4365-804a-9914533c8295 req-b0d00a43-987e-48f6-8532-19b4e169f03e service nova] Acquiring lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ecc58d41-eba7-4365-804a-9914533c8295 req-b0d00a43-987e-48f6-8532-19b4e169f03e service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ecc58d41-eba7-4365-804a-9914533c8295 req-b0d00a43-987e-48f6-8532-19b4e169f03e service nova] Lock "68c1ec23-dbbc-4015-af77-e9116595d8ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:36:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-ecc58d41-eba7-4365-804a-9914533c8295 req-b0d00a43-987e-48f6-8532-19b4e169f03e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] No waiting events found dispatching network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:36:27 user nova-compute[75216]: WARNING nova.compute.manager [req-ecc58d41-eba7-4365-804a-9914533c8295 req-b0d00a43-987e-48f6-8532-19b4e169f03e service nova] [instance: 68c1ec23-dbbc-4015-af77-e9116595d8ab] Received unexpected event network-vif-plugged-ae3a4027-bf5b-457a-b0b1-bf66381d6c0f for instance with vm_state deleted and task_state None.
Nov 02 05:36:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:36:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:36:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:36:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:36:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:36:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:36:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:36:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:36:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=24.863040924072266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:36:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:36:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:36:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:36:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquired lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lazy-loading 'info_cache' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [{"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Releasing lock "refresh_cache-9dd925a2-8024-4922-933c-b219cb623a24" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 05:36:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 05:36:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:37 user nova-compute[75216]: INFO nova.compute.manager [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Terminating instance
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-146e5783-4af8-4371-beb3-a1990107b8de req-f0595d3a-0f75-4d28-bd0e-c4157d3642b9 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-146e5783-4af8-4371-beb3-a1990107b8de req-f0595d3a-0f75-4d28-bd0e-c4157d3642b9 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-146e5783-4af8-4371-beb3-a1990107b8de req-f0595d3a-0f75-4d28-bd0e-c4157d3642b9 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-146e5783-4af8-4371-beb3-a1990107b8de req-f0595d3a-0f75-4d28-bd0e-c4157d3642b9 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-146e5783-4af8-4371-beb3-a1990107b8de req-f0595d3a-0f75-4d28-bd0e-c4157d3642b9 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-146e5783-4af8-4371-beb3-a1990107b8de req-f0595d3a-0f75-4d28-bd0e-c4157d3642b9 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Instance destroyed successfully.
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'resources' on Instance uuid 649e6f30-7b44-4cfa-8163-75ea92e2d030 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179035485',display_name='tempest-ServerRescueNegativeTestJSON-server-1179035485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179035485',id=51,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-j7cnv5g8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:22:47Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=649e6f30-7b44-4cfa-8163-75ea92e2d030,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "e88b951e-365c-4a37-98ee-db33fc9a342c", "address": "fa:16:3e:0e:fc:a7", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88b951e-36", "ovs_interfaceid": "e88b951e-365c-4a37-98ee-db33fc9a342c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG os_vif [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape88b951e-36, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b55e0453-108b-49e9-a51f-a0f0d1adfda2) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:37:37 user nova-compute[75216]: INFO os_vif [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:fc:a7,bridge_name='br-int',has_traffic_filtering=True,id=e88b951e-365c-4a37-98ee-db33fc9a342c,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88b951e-36')
Nov 02 05:37:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Deleting instance files /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030_del
Nov 02 05:37:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Deletion of /opt/stack/data/nova/instances/649e6f30-7b44-4cfa-8163-75ea92e2d030_del complete
Nov 02 05:37:38 user nova-compute[75216]: INFO nova.compute.manager [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 02 05:37:38 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:37:38 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Took 0.51 seconds to deallocate network for instance.
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-7d3eee1b-50e2-4792-9d10-9a4e7f944e34 req-b1a1100e-881e-4a4c-9cf6-14372246a7a0 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-deleted-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:37:38 user nova-compute[75216]: INFO nova.compute.manager [req-7d3eee1b-50e2-4792-9d10-9a4e7f944e34 req-b1a1100e-881e-4a4c-9cf6-14372246a7a0 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Neutron deleted interface e88b951e-365c-4a37-98ee-db33fc9a342c; detaching it from the instance and deleting it from the info cache
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-7d3eee1b-50e2-4792-9d10-9a4e7f944e34 req-b1a1100e-881e-4a4c-9cf6-14372246a7a0 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-7d3eee1b-50e2-4792-9d10-9a4e7f944e34 req-b1a1100e-881e-4a4c-9cf6-14372246a7a0 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Detach interface failed, port_id=e88b951e-365c-4a37-98ee-db33fc9a342c, reason: Instance 649e6f30-7b44-4cfa-8163-75ea92e2d030 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:37:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:38 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Deleted allocations for instance 649e6f30-7b44-4cfa-8163-75ea92e2d030
Nov 02 05:37:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22d5ae17-3062-4f7a-bf58-95ce977ca8ca tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.532s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:37:39 user nova-compute[75216]: WARNING nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state deleted and task_state None.
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:37:39 user nova-compute[75216]: WARNING nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state deleted and task_state None.
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:37:39 user nova-compute[75216]: WARNING nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state deleted and task_state None.
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:37:39 user nova-compute[75216]: WARNING nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-unplugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state deleted and task_state None.
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Acquiring lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] Lock "649e6f30-7b44-4cfa-8163-75ea92e2d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] No waiting events found dispatching network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:37:39 user nova-compute[75216]: WARNING nova.compute.manager [req-414be772-a3a0-4cd7-a6a1-387c1a65bc30 req-7ef0d9c4-1737-4336-809b-6fa6ca629795 service nova] [instance: 649e6f30-7b44-4cfa-8163-75ea92e2d030] Received unexpected event network-vif-plugged-e88b951e-365c-4a37-98ee-db33fc9a342c for instance with vm_state deleted and task_state None.
Nov 02 05:37:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:37:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:37:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:37:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:37:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:37:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:37:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:37:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:37:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:37:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:37:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:37:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 05:37:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 05:37:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:37:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:37:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.890239715576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Instance 9dd925a2-8024-4922-933c-b219cb623a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:37:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:37:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:37:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:37:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:38:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:38:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:38:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:38:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:38:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:38:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "9dd925a2-8024-4922-933c-b219cb623a24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:38:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:38:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:38:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:38:27 user nova-compute[75216]: INFO nova.compute.manager [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Terminating instance
Nov 02 05:38:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-a54eea12-e9a0-44a7-82c7-5dae17017811 req-a40060f5-b15b-4120-a05c-d604607a1bfe service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a54eea12-e9a0-44a7-82c7-5dae17017811 req-a40060f5-b15b-4120-a05c-d604607a1bfe service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a54eea12-e9a0-44a7-82c7-5dae17017811 req-a40060f5-b15b-4120-a05c-d604607a1bfe service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a54eea12-e9a0-44a7-82c7-5dae17017811 req-a40060f5-b15b-4120-a05c-d604607a1bfe service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-a54eea12-e9a0-44a7-82c7-5dae17017811 req-a40060f5-b15b-4120-a05c-d604607a1bfe service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-a54eea12-e9a0-44a7-82c7-5dae17017811 req-a40060f5-b15b-4120-a05c-d604607a1bfe service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-unplugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 05:38:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Instance destroyed successfully.
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lazy-loading 'resources' on Instance uuid 9dd925a2-8024-4922-933c-b219cb623a24 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T05:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-437711847',display_name='tempest-ServerRescueNegativeTestJSON-server-437711847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-437711847',id=50,image_ref='68d67248-2499-473c-a9cd-909ea99614c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T05:25:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d2dbfd63fb4326ba4d9eeb8bef7992',ramdisk_id='',reservation_id='r-m4odo907',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68d67248-2499-473c-a9cd-909ea99614c1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-979818861',owner_user_name='tempest-ServerRescueNegativeTestJSON-979818861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T05:27:35Z,user_data=None,user_id='a054457281864930a9803e8ce901dcd0',uuid=9dd925a2-8024-4922-933c-b219cb623a24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converting VIF {"id": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "address": "fa:16:3e:62:78:db", "network": {"id": "59315a30-9359-4d97-9b52-a09108c99e34", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-66673355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d2dbfd63fb4326ba4d9eeb8bef7992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac045d0-58", "ovs_interfaceid": "9ac045d0-585a-4a65-880d-1db5d9f63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG os_vif [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ac045d0-58, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46eb157b-e135-4949-b3af-be4a80a70ddf) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:28 user nova-compute[75216]: INFO os_vif [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:db,bridge_name='br-int',has_traffic_filtering=True,id=9ac045d0-585a-4a65-880d-1db5d9f63fd7,network=Network(59315a30-9359-4d97-9b52-a09108c99e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac045d0-58')
Nov 02 05:38:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Deleting instance files /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24_del
Nov 02 05:38:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Deletion of /opt/stack/data/nova/instances/9dd925a2-8024-4922-933c-b219cb623a24_del complete
Nov 02 05:38:28 user nova-compute[75216]: INFO nova.compute.manager [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 02 05:38:28 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 05:38:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 05:38:29 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 05:38:29 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Took 0.41 seconds to deallocate network for instance.
Nov 02 05:38:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:38:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:38:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:38:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:38:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:38:29 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Deleted allocations for instance 9dd925a2-8024-4922-933c-b219cb623a24
Nov 02 05:38:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4755ebc6-34a1-44ff-853c-22a1b4935cce tempest-ServerRescueNegativeTestJSON-979818861 tempest-ServerRescueNegativeTestJSON-979818861-project-member] Lock "9dd925a2-8024-4922-933c-b219cb623a24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.536s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:38:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-27def1a1-adaf-42f5-bb7e-c9e456a64f6f req-fd95c795-3569-4383-8ce9-7f6d406745f9 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:38:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-27def1a1-adaf-42f5-bb7e-c9e456a64f6f req-fd95c795-3569-4383-8ce9-7f6d406745f9 service nova] Acquiring lock "9dd925a2-8024-4922-933c-b219cb623a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:38:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-27def1a1-adaf-42f5-bb7e-c9e456a64f6f req-fd95c795-3569-4383-8ce9-7f6d406745f9 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:38:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-27def1a1-adaf-42f5-bb7e-c9e456a64f6f req-fd95c795-3569-4383-8ce9-7f6d406745f9 service nova] Lock "9dd925a2-8024-4922-933c-b219cb623a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:38:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-27def1a1-adaf-42f5-bb7e-c9e456a64f6f req-fd95c795-3569-4383-8ce9-7f6d406745f9 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] No waiting events found dispatching network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 05:38:30 user nova-compute[75216]: WARNING nova.compute.manager [req-27def1a1-adaf-42f5-bb7e-c9e456a64f6f req-fd95c795-3569-4383-8ce9-7f6d406745f9 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received unexpected event network-vif-plugged-9ac045d0-585a-4a65-880d-1db5d9f63fd7 for instance with vm_state deleted and task_state None.
Nov 02 05:38:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-27def1a1-adaf-42f5-bb7e-c9e456a64f6f req-fd95c795-3569-4383-8ce9-7f6d406745f9 service nova] [instance: 9dd925a2-8024-4922-933c-b219cb623a24] Received event network-vif-deleted-9ac045d0-585a-4a65-880d-1db5d9f63fd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 05:38:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:38:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:38:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:38:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:38:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=9093MB free_disk=24.91778564453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:38:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:38:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:38:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:38:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:38:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:38:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:38:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:39:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:39:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:39:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:39:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:39:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:39:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:39:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:39:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:39:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:39:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:39:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:39:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:39:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:39:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:39:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:39:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:39:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:39:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=24.908733367919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing inventories for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating ProviderTree inventory for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Updating inventory in ProviderTree for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing aggregate associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 05:39:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Refreshing trait associations for resource provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 05:39:55 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:39:55 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:39:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:39:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:39:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:39:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:39:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:39:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:39:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:39:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:40:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:40:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:40:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 05:40:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 05:40:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:40:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:40:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:40:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 05:40:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:40:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:40:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:40:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:40:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 05:40:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:40:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Hypervisor/Node resource view: name=user free_ram=9112MB free_disk=24.907047271728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed in ProviderTree for provider: d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Inventory has not changed for provider d3b4970b-ba9a-41a9-a7d1-fe8fcd3e6fd3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 05:40:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 05:40:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:40:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:41:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:41:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:41:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:41:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 05:41:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 05:41:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 05:41:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-393abcc3-0abd-4edd-b154-a3fdce9206a5 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 05:41:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:41:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 05:41:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 05:41:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:41:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 05:41:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:41:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:41:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:41:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:41:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 05:41:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}